{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "tQvt0YVXPaHO"
   },
   "source": [
    "### Agentic SFT Data generation with CAMEL and finetuning Meta models with Unsloth\n",
    "\n",
    "For more detailed usage information, please refer to our [cookbook](https://colab.research.google.com/drive/1fdBns2QA1XNwF_tsvG3Hc27QGdViHH3b?usp=sharing)\n",
    "\n",
    "To run this, press \"*Runtime*\" and press \"*Run all*\" on a **free** Tesla T4 Google Colab instance!\n",
    "<div class=\"align-center\">\n",
    "  <a href=\"https://www.camel-ai.org/\"><img src=\"https://i.postimg.cc/KzQ5rfBC/button.png\"width=\"150\"></a>\n",
    "  <a href=\"https://discord.camel-ai.org\"><img src=\"https://i.postimg.cc/L4wPdG9N/join-2.png\"  width=\"150\"></a></a>\n",
    "  \n",
    "⭐ <i>Star us on [*Github*](https://github.com/camel-ai/camel), join our [*Discord*](https://discord.camel-ai.org) or follow our [*X*](https://x.com/camelaiorg)\n",
    "</div>\n",
    "\n",
    "CAMEL and Unsloth make an excellent pair. In this notebook we will combine the two to train a model to be proficient at content on a page\n",
    "\n",
    "You will learn how to do data generation with CAMEL, how to train, and how to run the model."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "Hf-ePAgCPdI6"
   },
   "source": [
    "![SFT v2.png]()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "2eSvM9zX_2d3"
   },
   "outputs": [],
   "source": [
    "%%capture\n",
    "!pip install unsloth\n",
    "# Install CAMEL-AI with no optional dependencies\n",
    "!pip install camel-ai==0.2.16\n",
    "# Get Unsloth\n",
    "!pip install --upgrade --no-deps \"unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git@0de54572525788d09a6a9ef1efc7611e65dd7547\"\n",
    "!pip install firecrawl"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "r2v_X2fA0Df5"
   },
   "source": [
    "First we will set the OPENAI_API_KEY that will be used to generate the data.\n",
    "\n",
    "CAMEL supports many other models. See [here](https://docs.camel-ai.org/key_modules/models.html) for a list."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "gq4Q0u0ZTvGs",
    "outputId": "f80f1073-4c1d-4ec4-c154-665e841b95d8"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Enter your OpenAI API key: ··········\n",
      "Enter your Firecrawl API key: ··········\n"
     ]
    }
   ],
   "source": [
    "from getpass import getpass\n",
    "import os\n",
    "\n",
    "openai_api_key = getpass('Enter your OpenAI API key: ')\n",
    "os.environ[\"OPENAI_API_KEY\"] = openai_api_key\n",
    "\n",
    "# Generate an API key at https://www.firecrawl.dev/app/api-keys\n",
    "firecrawl_api_key = getpass('Enter your Firecrawl API key: ')\n",
    "os.environ[\"FIRECRAWL_API_KEY\"] = firecrawl_api_key"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Alternatively, if running on Colab, you could save your API keys and tokens as **Colab Secrets**, and use them across notebooks.\n",
    "\n",
    "To do so, **comment out** the above **manual** API key prompt code block(s), and **uncomment** the following codeblock.\n",
    "\n",
    "⚠️ Don't forget granting access to the API key you would be using to the current notebook."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# import os\n",
    "# from google.colab import userdata\n",
    "\n",
    "# os.environ[\"OPENAI_API_KEY\"] = userdata.get(\"OPENAI_API_KEY\")\n",
    "# os.environ[\"FIRECRAWL_API_KEY\"] = userdata.get(\"FIRECRAWL_API_KEY\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "iP5-hPz-0T6x"
   },
   "source": [
    "Next we will set up our model for training using Unsloth."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 441,
     "referenced_widgets": [
      "09744e002e3e47448b5c807424bf6956",
      "92408a369da54dd7bcddf6f6e50e9647",
      "eecd38a827cd4e7e94759e2497ed471e",
      "a9cf69cbe2314ec2a2e928e30db6dbfa",
      "eba29435f8f2428d87cf757c343bf6e7",
      "db51939f8da94b58a21cd945efc1bd63",
      "8058a98caaa5479c827c762dcaecdc7a",
      "ae99567a191740bcb1676c4bc71b8d57",
      "07f5cb55a7914ba994acda44294db8ac",
      "17d37e474ba34bedaa89830f543e5809",
      "57a028baaf034aa7b5ec44e4566f1802",
      "0d53408d8ede4b699ad2cf635938451b",
      "721b011e999e4f118facc65914af1c87",
      "09717565e7a94331b8e3e9618f5eb3af",
      "bd8a573b5b7a46a2b9e3f5fad61730e2",
      "04e99d4f4d784289bb5e442fac2f447c",
      "a92a81934edb4fc19c4603cdf9489559",
      "39d3a5a6441447fb88c2713a6baa918d",
      "3f60fe4920424667acf9a0bd9ec403de",
      "a978e1e9f9344a17899a8839372e0104",
      "6e9e0866439c444eb0830ddb2c0a8f0b",
      "95ed6c2c3131498e93f341159647cd75",
      "12c81caf98ed4c4cac311a021162a564",
      "3867254073fb4e52b1a56fb07752aa1c",
      "17bf788adc944f4cab1c8bdb0bb64b8d",
      "6026736dd09744f3b52ae6390cd89194",
      "c4252aeb37914583a57284bf0c6af3fe",
      "44768e2247cc472f85fb4191c7bebb4a",
      "63e04fcb4c784acc9a8e906840ce5777",
      "6e57e5cdca8643ee9e23a46b9ccdffb0",
      "8a695679ac3446518d3e61b30bc532f4",
      "eedbe8cf22f343289451142ddfd25b2e",
      "9e3b451a55984289a9ba58106387e823",
      "92cb2cbe77294e45b27041112bc1d7c6",
      "79f048b5c736497caae92fdc894a9224",
      "ed2e51a68ba346b38f59e95a264b72ac",
      "381c46960ece4da7aca34180ed6593ff",
      "9afdd6b7bc354237843b524026223185",
      "8474b7c07b744960928212e6ec6605bc",
      "5c24251b8c85417eb738e8cc73ec4cec",
      "3b1c9d5fa7e84af28dc1603a9d62d794",
      "12a89422ee874ad39ca8144c310b4014",
      "bbd573562ae14387818f82ddb2ff3c40",
      "b71a8f4df6824510b70262b9d0538f89",
      "a4b5c9dc622f4c4b95418ab1983fb63d",
      "97744bb661a8491d881b66201717650d",
      "a7dd14f4c0874c27afda0bf9af750d2e",
      "30d16cafe76f4c74913c81f826d40208",
      "00307ddeb366496abcb81dada5ec01e6",
      "1dd1ed4aaf964078b26b597c5318dc8e",
      "41da75ce3a1042469aebb4615aaad93b",
      "9a80c47aadd140c3ba4c56eeb533ac77",
      "85803d76d70c4cabaa1f1ddc88c36ef3",
      "bc3b2868f4994714a887a889e3a2a18e",
      "55e8c726ecf548b9b4fe6d5248bfd149",
      "195b7fa1e3c546f5a93c10ec03b728a9",
      "1591d9b09c8443579e37db07dbad1224",
      "c238699464f84887a715fadf4ce1f220",
      "b0f411fbcc474290b0f087b5ea9e8f08",
      "95b6473d466944ebbcf5532c2ddb7558",
      "c08e4858f6eb4c0ebd5c5af58e0b7328",
      "c85d4cd76dbe42a4bd0613fd01ebf787",
      "71bd3e831d2f446cac805d6253136f4d",
      "7dd901a8afe34e5c82523b3079deedbb",
      "6c7c652bb3204ee5bbc43662668b41f1",
      "50e2bab66cf844689c5fddbe818fec69"
     ]
    },
    "id": "QmUBVEnvCDJv",
    "outputId": "e741a69a-0c66-48a5-a27c-d1f994c0031a"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning.\n",
      "🦥 Unsloth Zoo will now patch everything to make training faster!\n",
      "==((====))==  Unsloth 2024.11.6: Fast Llama patching. Transformers = 4.47.0.\n",
      "   \\\\   /|    GPU: Tesla T4. Max memory: 14.748 GB. Platform = Linux.\n",
      "O^O/ \\_/ \\    Pytorch: 2.5.1+cu121. CUDA = 7.5. CUDA Toolkit = 12.1.\n",
      "\\        /    Bfloat16 = FALSE. FA [Xformers = 0.0.28.post3. FA2 = False]\n",
      " \"-____-\"     Free Apache license: http://github.com/unslothai/unsloth\n",
      "Unsloth: Fast downloading is enabled - ignore downloading bars which are red colored!\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Unsloth: unsloth/tinyllama-bnb-4bit can only handle sequence lengths of at most 2048.\n",
      "But with kaiokendev's RoPE scaling of 2.0, it can be magically be extended to 4096!\n"
     ]
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "09744e002e3e47448b5c807424bf6956",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "model.safetensors:   0%|          | 0.00/762M [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "0d53408d8ede4b699ad2cf635938451b",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "generation_config.json:   0%|          | 0.00/124 [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "12c81caf98ed4c4cac311a021162a564",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "tokenizer_config.json:   0%|          | 0.00/948 [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "92cb2cbe77294e45b27041112bc1d7c6",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "tokenizer.model:   0%|          | 0.00/500k [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "a4b5c9dc622f4c4b95418ab1983fb63d",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "special_tokens_map.json:   0%|          | 0.00/438 [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "195b7fa1e3c546f5a93c10ec03b728a9",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "tokenizer.json:   0%|          | 0.00/1.84M [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Unsloth 2024.11.6 patched 22 layers with 22 QKV layers, 22 O layers and 22 MLP layers.\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Unsloth: Training embed_tokens in mixed precision to save VRAM\n",
      "Unsloth: Training lm_head in mixed precision to save VRAM\n"
     ]
    }
   ],
   "source": [
    "from unsloth import FastLanguageModel\n",
    "import torch\n",
    "max_seq_length = 4096\n",
    "dtype = None\n",
    "load_in_4bit = True\n",
    "\n",
    "model, tokenizer = FastLanguageModel.from_pretrained(\n",
    "    model_name = \"unsloth/tinyllama-bnb-4bit\", # \"unsloth/tinyllama\" for 16bit loading\n",
    "    max_seq_length = max_seq_length,\n",
    "    dtype = dtype,\n",
    "    load_in_4bit = load_in_4bit,\n",
    "    # token = \"hf_...\", # use one if using gated models like meta-llama/Llama-2-7b-hf\n",
    ")\n",
    "model = FastLanguageModel.get_peft_model(\n",
    "    model,\n",
    "    r = 32,\n",
    "    target_modules = [\"q_proj\", \"k_proj\", \"v_proj\", \"o_proj\",\n",
    "                      \"gate_proj\", \"up_proj\", \"down_proj\",\n",
    "                      \"embed_tokens\", \"lm_head\"],\n",
    "    lora_alpha = 32,\n",
    "    use_gradient_checkpointing = False, # @@@ IF YOU GET OUT OF MEMORY - set to True @@@\n",
    "    random_state = 3407,\n",
    "    use_rslora = False,  # We support rank stabilized LoRA\n",
    "    loftq_config = None, # And LoftQ\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "RCb9quu7bcGE"
   },
   "source": [
    "Now as a control, lets see how this model does with our CAMEL-specific question"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "YqQz8vdrbbrF",
    "outputId": "76f54930-21ec-4935-ea7a-4bfe6dd44d01"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['<s> ### Instruction:\\nExplain how can I stay up to date with the CAMEL community.\\n\\n### Input:\\n\\n\\n### Response:\\n\\n\\n## Output\\n\\n\\n### Input\\n\\n\\n## Response\\n\\n\\n##\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n']"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from camel.messages.conversion import AlpacaItem\n",
    "\n",
    "temp_model = FastLanguageModel.for_inference(model) # Enable native 2x faster inference\n",
    "inputs = tokenizer(\n",
    "[\n",
    "\n",
    "   AlpacaItem(\n",
    "       instruction=\"Explain how can I stay up to date with the CAMEL community.\",\n",
    "       input=\"\",\n",
    "       output=\"\", # leave this blank for generation!\n",
    "   ).to_string()\n",
    "\n",
    "], return_tensors = \"pt\").to(\"cuda\")\n",
    "\n",
    "outputs = temp_model.generate(**inputs, max_new_tokens = 512, use_cache = True)\n",
    "temp_model = None\n",
    "tokenizer.batch_decode(outputs)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "JshfcE5kdp2n"
   },
   "source": [
    "Note that it hasn't been trained on this output format, so the output is total junk"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "_X_Nydp9K47x"
   },
   "source": [
    "### Data models\n",
    "We want to generate data in the Alpaca format, so we can use CAMEL's built-in AlpacaItem class which has some handy conversion functions for us.\n",
    "\n",
    "We will be using CAMEL's structured output to generate all of these items in one request, which is much faster and cheaper.\n",
    "\n",
    "\n",
    "Here we create a wrapper around the AlpacaItem to help the model know how many have been generated as it's going along, and another wrapper class that represents a list of these."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "TdJnqzXWuAUK"
   },
   "outputs": [],
   "source": [
    "from pydantic import BaseModel\n",
    "\n",
    "class NumberedAlpacaItem(BaseModel):\n",
    "    number: int\n",
    "    item: AlpacaItem\n",
    "\n",
    "\n",
    "class AlpacaItemResponse(BaseModel):\n",
    "    \"\"\"\n",
    "    Represents an instruction-response item in the Alpaca format.\n",
    "    \"\"\"\n",
    "    items: list[NumberedAlpacaItem]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "vITh0KVJ10qX"
   },
   "source": [
    "<a name=\"Data\"></a>\n",
    "### Data generation\n",
    "Next we define our data generation function. It takes a source content, and generates a list of instruction-input-response triplets around it.\n",
    "\n",
    "We will use this later to train our model to be proficient with the source content."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "mBno-K2rTCfS"
   },
   "outputs": [],
   "source": [
    "from typing import List\n",
    "from camel.loaders import Firecrawl\n",
    "from camel.models import ModelFactory\n",
    "from camel.types import ModelPlatformType, ModelType\n",
    "from camel.configs import ChatGPTConfig\n",
    "from camel.agents import ChatAgent\n",
    "import json\n",
    "\n",
    "\n",
    "def generate_alpaca_items(content: str, n_items: int, start_num: int = 1, examples: List[AlpacaItem] = None) -> List[AlpacaItem]:\n",
    "    system_msg = \"\"\"\n",
    "You are an AI assistant generating detailed, accurate responses based on the provided content.\n",
    "You will be given a reference content, and you must generate a specific number of AlpacaItems.\n",
    "These are instruction-input-response triplets, where the input is the context or examples.\n",
    "\n",
    "Add a number to the items to keep track of the order. Generate exactly that many.\n",
    "\n",
    "For each instruction, imagine but do not include a real world scenario and real user in that scenario to inform realistic and varied instructions. Avoid common sense questions and answers.\n",
    "\n",
    "Include multiple lines in the output as appropriate to provide sufficient detail. Cite the most relevant context verbatim in output fields, do not omit anything important.\n",
    "\n",
    "Leave the input field blank.\n",
    "\n",
    "Ensure all of the most significant parts of the context are covered.\n",
    "\n",
    "Start with open ended instructions, then move to more specific ones. Consider the starting number for an impression of what has already been generated.\n",
    "    \"\"\"\n",
    "\n",
    "    examples_str = \"\"\n",
    "    if examples:\n",
    "        examples_str = \"\\n\\nHere are some example items for reference:\\n\" + \\\n",
    "            \"\\n\".join(ex.model_dump_json() for ex in examples)\n",
    "\n",
    "    model = ModelFactory.create(\n",
    "        model_platform=ModelPlatformType.OPENAI,\n",
    "        model_type=ModelType.GPT_4O_MINI,\n",
    "        model_config_dict=ChatGPTConfig(\n",
    "            temperature=0.6, response_format=AlpacaItemResponse\n",
    "        ).as_dict(),\n",
    "    )\n",
    "\n",
    "    agent = ChatAgent(\n",
    "        system_message=system_msg,\n",
    "        model=model,\n",
    "    )\n",
    "\n",
    "    prompt = f\"Content reference:\\n{content}{examples_str}\\n\\n Generate {n_items} AlpacaItems. The first should start numbering at {start_num}.\"\n",
    "    response = agent.step(prompt)\n",
    "\n",
    "    # Parse the generated JSON to our wrapper class\n",
    "    alpaca_items = [n_item.item for n_item in\n",
    "                    AlpacaItemResponse.\n",
    "                    model_validate_json(response.msgs[0].content).items]\n",
    "\n",
    "    return alpaca_items\n",
    "\n",
    "\n",
    "def save_json(data: List, filename: str):\n",
    "    with open(filename, 'w', encoding='utf-8') as f:\n",
    "        json.dump([entry.model_dump() for entry in data], f, indent=2,\n",
    "                  ensure_ascii=False)\n",
    "\n",
    "\n",
    "# Few shot examples to ensure the right amount of detail\n",
    "examples = [\n",
    "    AlpacaItem(\n",
    "        instruction=\"Explain the process for sprint planning and review in CAMEL.\",\n",
    "        input=\"\",\n",
    "        output=\"The process for sprint planning and review in CAMEL includes:\\n1. **Sprint Duration**: Each sprint lasts two weeks for development and one week for review.\\n2. **Planning Meeting**: Conducted biweekly, where the founder highlights the sprint goal and developers select items for the sprint.\\n3. **Review Meeting**: Stakeholders review the delivered features and provide feedback on the work completed during the sprint.\"\n",
    "    )\n",
    "]\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "AqdoebfqMxb2"
   },
   "source": [
    "# Point to content and generate data!\n",
    "Now we point to the content that we wish to generate SFT data around and use CAMEL's Firecrawl integration to get this content in a nice markdown format.\n",
    "\n",
    "You can get a Firecrawl API key from [here](https://www.firecrawl.dev/app/api-keys)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "background_save": true,
     "base_uri": "https://localhost:8080/"
    },
    "id": "LxkdPzNVMvmH",
    "outputId": "dea61d62-2f92-4d2b-9466-c53f6d466da1"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Generated 50 items\n",
      "Generated 50 items\n",
      "Generated 50 items\n",
      "Generated 50 items\n",
      "Generated 50 items\n",
      "Generated 40 items\n",
      "[AlpacaItem(instruction='Summarize the guidelines for contributing to the CAMEL project.', input='', output='The guidelines for contributing to the CAMEL project include:\\n- **Open Source Initiative**: Contributions of all types are welcomed, whether they involve introducing new features, enhancing infrastructure, improving documentation, or fixing bugs.\\n- **Fork-and-Pull-Request Workflow**: Community contributors should follow this workflow for submitting pull requests.\\n- **Documentation and Testing**: Contributors must ensure thorough documentation and testing of their code.\\n- **Code Review Process**: All pull requests must be reviewed by at least two reviewers before merging.'), AlpacaItem(instruction='Describe how to join the CAMEL community.', input='', output='To join the CAMEL community, you can:\\n- Participate in discussions on **Discord** by joining the dedicated server.\\n- Schedule an introduction call via Calendly for English or Chinese speakers.\\n- Engage with community members through various channels including **Slack** and **WeChat**.'), AlpacaItem(instruction='What are the steps to write a cookbook entry for CAMEL?', input='', output='The steps to write a cookbook entry for CAMEL are:\\n1. **Use the Template**: Follow the provided [template](https://colab.research.google.com/drive/17SiWWjoK7l8Sy9FBsGKUHC6zuEsLt2yX?usp=sharing) for consistency.\\n2. **Write in Google Colab**: Start writing your entry in Google Colab to allow interactive code execution.\\n3. **Ensure Correctness**: Verify that all LLM-generated responses are correct and executable.\\n4. **Clear Explanations**: Provide clear explanations and document complex logic.'), AlpacaItem(instruction='Outline the code review process for CAMEL.', input='', output='The code review process for CAMEL involves:\\n1. **Reviewers Check Code**: Reviewers verify functionality, readability, consistency, and adherence to coding standards.\\n2. **Constructive Feedback**: If changes are needed, reviewers provide constructive feedback.\\n3. **Addressing Feedback**: Contributors address feedback and update their pull requests.\\n4. **Approval and Merging**: Once approved by at least two reviewers, the code can be merged.'), AlpacaItem(instruction='Explain how to submit a cookbook entry to CAMEL.', input='', output='To submit a cookbook entry to CAMEL, follow these steps:\\n1. **Finalize in Colab**: Ensure your cookbook entry is finalized and reviewed in Google Colab.\\n2. **Download the Notebook**: Download the completed notebook as a .ipynb file.\\n3. **Create a Pull Request**: Open a pull request on GitHub to add the cookbook to the docs folder, including the downloadable file and necessary documentation.'), AlpacaItem(instruction='What should contributors include in their pull requests?', input='', output='Contributors should include the following in their pull requests:\\n- A clear and descriptive title.\\n- Links to any related issues.\\n- An update of the Reviewers, Assignees, Labels, and Milestones.\\n- Mention of any relevant documentation updates or dependencies.'), AlpacaItem(instruction='Summarize the principles for writing docstrings in CAMEL.', input='', output='The principles for writing docstrings in CAMEL include:\\n1. **Use Raw String**: Start with `r\"\"\"` to prevent issues with special characters.\\n2. **Brief Description**: Provide a concise summary of the class or method\\'s purpose.\\n3. **Document Parameters**: Use an `Args:` section for documenting parameters with type and default values.'), AlpacaItem(instruction='What are the key considerations for contributing to code reviews?', input='', output=\"Key considerations for contributing to code reviews include:\\n- **Timely Reviews**: Reviewers should aim to review pull requests promptly.\\n- **Constructive Feedback**: Provide clear and constructive feedback aimed at improving the contributor's work.\\n- **Collaboration**: Work collaboratively with contributors to address issues and ensure code quality.\"), AlpacaItem(instruction='List the steps for updating dependencies in CAMEL.', input='', output='To update dependencies in CAMEL, follow these steps:\\n1. Modify the `pyproject.toml` file as necessary.\\n2. Run `poetry lock` to synchronize the dependencies with the lock file.'), AlpacaItem(instruction='Describe the purpose of sprint planning in CAMEL.', input='', output='The purpose of sprint planning in CAMEL is to define what can be delivered in the upcoming sprint and how it will be achieved. It involves setting goals and selecting items for the sprint.'), AlpacaItem(instruction='What is the process for conducting a sprint review in CAMEL?', input='', output='The process for conducting a sprint review in CAMEL includes:\\n- Stakeholders review the delivered features from the sprint.\\n- Gather feedback on the work completed during the sprint.'), AlpacaItem(instruction='Explain the role of logging in CAMEL.', input='', output=\"In CAMEL, logging is preferred over using print statements. Contributors should use Python's `logging` module to ensure consistent and professional logging across the codebase.\"), AlpacaItem(instruction='What are the common actions contributors should take before pushing code?', input='', output='Before pushing code, contributors should perform the following common actions:\\n- Run `pre-commit run --all-files` to ensure code is auto-formatted and linted.\\n- Run unit tests with `pytest test` to ensure all tests pass.'), AlpacaItem(instruction='Outline the steps for building documentation locally for CAMEL.', input='', output='To build documentation locally for CAMEL, follow these steps:\\n1. Navigate to the `docs` directory.\\n2. Execute the command `make html` to generate HTML documentation.'), AlpacaItem(instruction='What guidelines should contributors follow when fixing bugs?', input='', output='When fixing bugs, contributors should follow these guidelines:\\n- Add relevant unit tests when possible, located in the `test` directory.\\n- Ensure that the bug fix addresses all reported issues.'), AlpacaItem(instruction='Explain the importance of reproducibility in the CAMEL cookbook.', input='', output='Reproducibility in the CAMEL cookbook is crucial as it ensures that users can replicate the results by following the provided steps and executing the code. This enhances the reliability of the cookbook entries.'), AlpacaItem(instruction='Summarize the principles for writing high-quality cookbook entries.', input='', output='The principles for writing high-quality cookbook entries include:\\n- Ensuring accuracy of code and explanations.\\n- Providing clear, concise, and well-structured content.\\n- Including interactive elements where applicable.'), AlpacaItem(instruction=\"What should be included in the 'Args' section of a docstring?\", input='', output=\"The 'Args' section of a docstring should include:\\n- Parameter Name: Match the function signature.\\n- Type: Specify the type of the parameter.\\n- Description: Brief explanation of the parameter's role.\\n- Default Value: Indicate default values using the format (default: :obj:<default_value>).\"), AlpacaItem(instruction='Describe the role of the CAMEL community in contributing to the project.', input='', output='The CAMEL community plays a vital role in contributing to the project by:\\n- Providing feedback and suggestions to improve the codebase.\\n- Engaging in discussions on development and features.\\n- Assisting in documentation and testing efforts.'), AlpacaItem(instruction='What is the purpose of the CAMEL cookbook?', input='', output='The purpose of the CAMEL cookbook is to serve as a comprehensive resource for users, providing practical examples and recipes that demonstrate how to use CAMEL effectively.'), AlpacaItem(instruction='What are the steps for running unit tests in CAMEL?', input='', output='The steps for running unit tests in CAMEL are:\\n1. Ensure all dependencies are installed.\\n2. Run the command `pytest .` to execute all tests.'), AlpacaItem(instruction=\"Explain the significance of issue management in CAMEL's development process.\", input='', output=\"Issue management is significant in CAMEL's development process as it helps track bugs, improvements, and feature requests, ensuring that contributions are organized and prioritized effectively.\"), AlpacaItem(instruction='What guidelines should be followed when adding new features to CAMEL?', input='', output='When adding new features to CAMEL, contributors should:\\n- Include unit tests in the `test` directory.\\n- Update any affected examples and documentation to reflect the new feature.'), AlpacaItem(instruction='Summarize the importance of community engagement in CAMEL.', input='', output=\"Community engagement in CAMEL is important as it fosters collaboration, promotes knowledge sharing, and encourages contributions that enhance the project's development and sustainability.\"), AlpacaItem(instruction='What are the steps for conducting code reviews in CAMEL?', input='', output='The steps for conducting code reviews in CAMEL include:\\n1. Reviewers examine the code for functionality and readability.\\n2. Provide constructive feedback to the contributor.\\n3. Contributor addresses feedback and submits updates.\\n4. Reviewers approve the code if it meets standards.'), AlpacaItem(instruction='What should be done if a contributor encounters issues during setup?', input='', output='If a contributor encounters issues during setup, they should reach out to a maintainer for assistance to ensure a smooth experience for themselves and future contributors.'), AlpacaItem(instruction='Explain the significance of maintaining high-quality documentation in CAMEL.', input='', output='Maintaining high-quality documentation in CAMEL is significant as it provides clear guidance for users and contributors, facilitating better understanding and usage of the project.'), AlpacaItem(instruction='What are the best practices for naming variables in CAMEL?', input='', output='Best practices for naming variables in CAMEL include:\\n- Avoiding abbreviations to prevent ambiguity.\\n- Using clear and descriptive names that convey meaning.'), AlpacaItem(instruction='What is the purpose of the `logger` in CAMEL?', input='', output='The purpose of the `logger` in CAMEL is to provide a consistent and configurable way to log information, replacing traditional print statements for professional logging.'), AlpacaItem(instruction='List the steps to create a pull request in CAMEL.', input='', output='To create a pull request in CAMEL, follow these steps:\\n1. Go to the GitHub Pull Requests page.\\n2. Create a new PR and select the relevant branch.\\n3. Fill in the required information, linking to any related issue.\\n4. Update the Reviewers, Assignees, Labels, and Milestones.'), AlpacaItem(instruction='What should contributors do if they encounter outdated issues on GitHub?', input='', output='If contributors encounter outdated issues on GitHub, they should notify the maintainers to ensure that the issue list remains current and relevant.'), AlpacaItem(instruction='Explain the importance of security in the code review process.', input='', output='Security is important in the code review process as it helps identify potential vulnerabilities and ensures that no harmful code is introduced into the codebase.'), AlpacaItem(instruction='What are the steps for running coverage reports in CAMEL?', input='', output='To run coverage reports in CAMEL, follow these steps:\\n1. Execute `coverage erase` to clear previous data.\\n2. Run `coverage run --source=. -m pytest .` to measure coverage.\\n3. Generate an HTML report using `coverage html`.'), AlpacaItem(instruction='Describe the significance of unit tests in CAMEL.', input='', output='Unit tests are significant in CAMEL as they ensure that individual components function correctly, helping to catch bugs early in the development process and maintain code quality.'), AlpacaItem(instruction='What should be included in the documentation for new features in CAMEL?', input='', output=\"Documentation for new features in CAMEL should include:\\n- Clear explanations of the feature's purpose and functionality.\\n- Examples of how to use the feature.\\n- Any relevant updates to existing documentation.\"), AlpacaItem(instruction='Summarize the steps for scheduling an introduction call with CAMEL.', input='', output='To schedule an introduction call with CAMEL, you can:\\n1. Choose the appropriate link for your language (English or Chinese).\\n2. Select a suitable time slot on the Calendly page.'), AlpacaItem(instruction='What are the guidelines for updating documentation in CAMEL?', input='', output='Guidelines for updating documentation in CAMEL include:\\n- Ensure that all changes are accurate and reflect the current state of the code.\\n- Maintain clarity and consistency in formatting.\\n- Add examples and explanations where necessary.'), AlpacaItem(instruction='Explain the process for managing issues on GitHub for CAMEL.', input='', output='The process for managing issues on GitHub for CAMEL involves:\\n1. Regularly updating the issues page with bugs, improvements, and feature requests.\\n2. Assigning issues to contributors when they start working on them.\\n3. Linking related issues instead of merging them into one.'), AlpacaItem(instruction='What are the key components of a successful sprint planning session?', input='', output='Key components of a successful sprint planning session include:\\n- Setting a clear sprint goal.\\n- Reviewing the backlog and selecting items for the sprint.\\n- Estimating the effort required for each item.'), AlpacaItem(instruction='What is the significance of project labels in CAMEL?', input='', output='Project labels in CAMEL are significant as they help categorize issues and pull requests, making it easier to track progress and prioritize work.'), AlpacaItem(instruction='Describe the importance of accessibility in the CAMEL cookbook.', input='', output='Accessibility in the CAMEL cookbook is important to ensure that users of all skill levels can understand and utilize the content effectively, enhancing the overall user experience.'), AlpacaItem(instruction='What should reviewers check for during code reviews?', input='', output='Reviewers should check for the following during code reviews:\\n- Functionality: Does the code perform as expected?\\n- Readability: Is the code easy to read and understand?\\n- Tests: Is there sufficient test coverage?'), AlpacaItem(instruction='Summarize the steps to run the CAMEL virtual environment.', input='', output='To run the CAMEL virtual environment, follow these steps:\\n1. Clone the GitHub repository.\\n2. Change directory into the project folder.\\n3. Activate the virtual environment using `poetry shell`.'), AlpacaItem(instruction='What are the best practices for writing clear explanations in the CAMEL cookbook?', input='', output='Best practices for writing clear explanations in the CAMEL cookbook include:\\n- Using simple language and avoiding jargon.\\n- Breaking down complex concepts into manageable parts.\\n- Providing examples to illustrate points.'), AlpacaItem(instruction='Describe how to ensure code quality in CAMEL.', input='', output='To ensure code quality in CAMEL, contributors should:\\n- Follow coding standards and guidelines.\\n- Write comprehensive tests for new features.\\n- Participate in code reviews and address feedback.'), AlpacaItem(instruction='What is the purpose of the `pre-commit` hook in CAMEL?', input='', output='The `pre-commit` hook in CAMEL is used to automatically format and lint code before it is committed, ensuring that all contributions adhere to project standards.'), AlpacaItem(instruction='List the key elements of the CAMEL community guidelines.', input='', output='Key elements of the CAMEL community guidelines include:\\n- Welcoming contributions of all kinds.\\n- Encouraging respectful and constructive communication.\\n- Supporting collaboration and knowledge sharing.'), AlpacaItem(instruction='What should be included in a pull request description in CAMEL?', input='', output='A pull request description in CAMEL should include:\\n- A summary of the changes made.\\n- References to any related issues.\\n- A description of how the changes were tested.'), AlpacaItem(instruction='Explain the role of maintainers in the CAMEL project.', input='', output=\"Maintainers in the CAMEL project play a crucial role in overseeing contributions, ensuring code quality, managing issues, and guiding the project's direction and community engagement.\"), AlpacaItem(instruction='What are the common pitfalls to avoid when contributing to CAMEL?', input='', output='Common pitfalls to avoid when contributing to CAMEL include:\\n- Submitting large pull requests without breaking them down.\\n- Ignoring feedback from code reviews.\\n- Rushing through the review process.'), AlpacaItem(instruction='Describe how to contribute to the CAMEL project.', input='', output=\"To contribute to the CAMEL project, follow these steps:\\n1. **Join the Community**: Engage with the community via Discord or other communication channels.\\n2. **Fork the Repository**: Use the Fork-and-Pull-Request workflow for contributions.\\n3. **Make Changes**: Implement your changes, ensuring they align with the project's guidelines.\\n4. **Submit a Pull Request**: Open a pull request, mentioning any related issues and tagging relevant maintainers.\"), AlpacaItem(instruction='What are the guidelines for writing docstrings in CAMEL?', input='', output='The guidelines for writing docstrings in CAMEL include:\\n1. **Use Raw String**: Start with `r\"\"\"` to avoid issues with special characters.\\n2. **Brief Description**: Provide a concise summary of the class or method\\'s purpose.\\n3. **Document Parameters**: Use an `Args` section to detail parameters, types, descriptions, and default values.'), AlpacaItem(instruction='Explain the process for contributing to cookbook writing in CAMEL.', input='', output='To contribute to cookbook writing in CAMEL:\\n1. **Use the Template**: Follow the provided template for uniformity in style and structure.\\n2. **Write in Colab**: Utilize Google Colab to write and review cookbooks interactively.\\n3. **Ensure Correctness**: Verify that all LLM-generated responses are accurate through real code execution.'), AlpacaItem(instruction='What is the purpose of code reviews in the CAMEL project?', input='', output='The purpose of code reviews in CAMEL is to:\\n1. **Maintain Code Quality**: Ensure the codebase remains clean and maintainable.\\n2. **Facilitate Knowledge Sharing**: Help contributors learn best practices.\\n3. **Prevent Bugs**: Catch potential issues before merging into the main branch.'), AlpacaItem(instruction='List the principles for writing high-quality cookbook entries.', input='', output='The principles for writing high-quality cookbook entries include:\\n1. **High Quality**: Ensure accurate code and well-written explanations.\\n2. **Reproducibility**: Code must yield the same results for any user.\\n3. **Accessibility**: Content should be understandable for users at all skill levels.'), AlpacaItem(instruction='What should be included in a pull request for CAMEL?', input='', output='A pull request for CAMEL should include:\\n1. **Proper Title**: Clearly describe the changes made.\\n2. **Linked Issues**: Reference any related issues.\\n3. **Reviewers and Assignees**: Update these fields appropriately.\\n4. **Labeling**: Use relevant labels such as `feat`, `fix`, `docs`, etc.'), AlpacaItem(instruction='What are the steps to run unit tests in CAMEL?', input='', output=\"To run unit tests in CAMEL:\\n1. **Activate Virtual Environment**: Ensure you're in the camel virtual environment.\\n2. **Run Tests**: Execute the command `pytest .` to run all tests.\"), AlpacaItem(instruction='Explain the significance of the Fork-and-Pull-Request workflow in CAMEL.', input='', output='The Fork-and-Pull-Request workflow is significant in CAMEL as it allows contributors to work on their changes independently and submit them for review, ensuring a structured and organized contribution process.'), AlpacaItem(instruction='What is the role of the CAMEL community in the development process?', input='', output='The CAMEL community plays a crucial role in the development process by:\\n1. **Providing Feedback**: Community members can offer insights and suggestions.\\n2. **Facilitating Collaboration**: Encourages teamwork and shared learning among contributors.\\n3. **Supporting New Contributors**: Helps newcomers understand the project and get involved.'), AlpacaItem(instruction=\"List the steps for managing issues in CAMEL's development process.\", input='', output=\"To manage issues in CAMEL's development process:\\n1. **Create an Issue**: Use the GitHub issues page to report bugs or request features.\\n2. **Assign Issues**: Assign issues to yourself when working on them.\\n3. **Discuss in Meetings**: Bring up issues during team meetings for analysis and planning.\"), AlpacaItem(instruction='What are the best practices for conducting code reviews in CAMEL?', input='', output='Best practices for conducting code reviews in CAMEL include:\\n1. **Timely Reviews**: Strive to review pull requests promptly.\\n2. **Constructive Feedback**: Provide clear and helpful feedback to contributors.\\n3. **Thorough Checks**: Ensure the code adheres to quality standards before approval.'), AlpacaItem(instruction='Explain the process for submitting a cookbook to CAMEL.', input='', output='To submit a cookbook to CAMEL:\\n1. **Finalize the Draft**: Ensure the Colab notebook is complete and reviewed.\\n2. **Download as .ipynb**: Save the finalized notebook.\\n3. **Open a Pull Request**: Submit the .ipynb file along with necessary documentation.'), AlpacaItem(instruction='What are the communication channels available for CAMEL contributors?', input='', output='The communication channels available for CAMEL contributors include:\\n1. **Discord**: For real-time discussions and support.\\n2. **WeChat**: For Chinese-speaking contributors.\\n3. **Slack**: For collaborative messaging and updates.'), AlpacaItem(instruction='Describe the importance of documentation in the CAMEL project.', input='', output='Documentation is important in the CAMEL project because it:\\n1. **Guides Users**: Provides clear instructions on how to use the project.\\n2. **Facilitates Contributions**: Helps new contributors understand how to contribute effectively.\\n3. **Enhances Project Usability**: Ensures that features and functionalities are well-explained.'), AlpacaItem(instruction='What are the steps involved in sprint planning for CAMEL?', input='', output='The steps involved in sprint planning for CAMEL include:\\n1. **Define Sprint Goals**: Establish the objectives for the upcoming sprint.\\n2. **Select Items**: Developers choose items from the backlog to work on.\\n3. **Discuss and Analyze**: Review items during team meetings for feasibility.'), AlpacaItem(instruction='Outline the guidelines for writing unit tests in CAMEL.', input='', output='The guidelines for writing unit tests in CAMEL include:\\n1. **Coverage**: Ensure sufficient test coverage for all critical functionalities.\\n2. **Correctness**: Tests should accurately verify that the code performs as expected.\\n3. **Structured**: Organize tests logically within the `test` directory.'), AlpacaItem(instruction='Explain how to build documentation locally for CAMEL.', input='', output='To build documentation locally for CAMEL:\\n1. **Navigate to `docs` Directory**: Change into the documentation directory.\\n2. **Run Build Command**: Execute `make html` to generate the HTML documentation.'), AlpacaItem(instruction='What is the significance of using `logger` instead of `print` in CAMEL?', input='', output='Using `logger` instead of `print` is significant in CAMEL because it:\\n1. **Ensures Consistency**: Provides a uniform logging mechanism across the codebase.\\n2. **Configurable Levels**: Allows for different levels of logging (info, debug, error) for better control.\\n3. **Professional Logging**: Facilitates better tracking and debugging of application behavior.'), AlpacaItem(instruction='What are the required steps for updating dependencies in CAMEL?', input='', output='To update dependencies in CAMEL:\\n1. **Modify `pyproject.toml`**: Make necessary changes to the dependencies.\\n2. **Run `poetry lock`**: Synchronize the changes with the lock file.'), AlpacaItem(instruction='Describe the principles to follow when writing code for CAMEL.', input='', output='The principles to follow when writing code for CAMEL include:\\n1. **Clarity**: Use descriptive variable names and avoid abbreviations.\\n2. **Documentation**: Ensure all public methods and complex logic are well-documented.\\n3. **Modularity**: Write code that is modular and self-contained to promote reusability.'), AlpacaItem(instruction='What are the guidelines for contributing to documentation in CAMEL?', input='', output='Guidelines for contributing to documentation in CAMEL include:\\n1. **Comprehensive Coverage**: Provide documentation for all classes and methods.\\n2. **Clarity and Detail**: Ensure explanations are clear and detailed.'), AlpacaItem(instruction='Explain the process of conducting a sprint review in CAMEL.', input='', output='The process of conducting a sprint review in CAMEL includes:\\n1. **Review Delivered Features**: Stakeholders review the work completed during the sprint.\\n2. **Gather Feedback**: Collect feedback on the features and identify areas for improvement.'), AlpacaItem(instruction='What should contributors do if they encounter issues during setup?', input='', output='If contributors encounter issues during setup, they should reach out to a maintainer for assistance to ensure a smooth setup experience.'), AlpacaItem(instruction='Outline the steps for running pre-commit hooks in CAMEL.', input='', output='To run pre-commit hooks in CAMEL:\\n1. **Install Pre-Commit**: Ensure pre-commit is installed in your environment.\\n2. **Run Hooks**: Execute `pre-commit run --all-files` before pushing changes.'), AlpacaItem(instruction='What are the key components of the CAMEL development workflow?', input='', output='The key components of the CAMEL development workflow include:\\n1. **Issue Creation**: Tracking bugs and feature requests.\\n2. **Pull Requests**: Submitting changes for review.\\n3. **Sprint Planning**: Organizing work into manageable sprints.'), AlpacaItem(instruction='Explain the significance of the CAMEL license.', input='', output='The significance of the CAMEL license (Apache 2.0) is that it allows for open-source collaboration while protecting contributors and users, ensuring that contributions are recognized and can be used freely.'), AlpacaItem(instruction='What are the steps for integrating a cookbook into the CAMEL documentation?', input='', output='To integrate a cookbook into the CAMEL documentation:\\n1. **Finalize the Cookbook**: Ensure the content is reviewed and correct.\\n2. **Create a Pull Request**: Submit the .ipynb file along with any necessary documentation.'), AlpacaItem(instruction='Outline the process for scheduling an introduction call for CAMEL.', input='', output='The process for scheduling an introduction call for CAMEL includes:\\n1. **Select Language**: Choose between English or Chinese.\\n2. **Use Calendly Links**: Access the provided Calendly links to book a time.'), AlpacaItem(instruction='What are the key points to remember when writing interactive elements for the CAMEL cookbook?', input='', output='When writing interactive elements for the CAMEL cookbook, remember to:\\n1. **Include Code Cells**: Add interactive code cells for users to run and modify.\\n2. **Provide Clear Explanations**: Ensure explanations are clear and concise, guiding users through the interactive elements.'), AlpacaItem(instruction=\"Describe the importance of issue labels in CAMEL's GitHub repository.\", input='', output=\"Issue labels in CAMEL's GitHub repository are important because they help categorize and prioritize issues, making it easier for contributors to find relevant tasks and for maintainers to manage the backlog.\"), AlpacaItem(instruction='What actions should be taken after merging a pull request in CAMEL?', input='', output='After merging a pull request in CAMEL, the following actions should be taken:\\n1. **Close Related Issues**: Automatically close any linked issues.\\n2. **Review Feedback**: Consider any feedback received during the review process for future improvements.'), AlpacaItem(instruction='Outline the steps for ensuring code quality in CAMEL.', input='', output='To ensure code quality in CAMEL:\\n1. **Conduct Code Reviews**: Regularly review code for adherence to standards.\\n2. **Run Linting and Formatting**: Use tools like Ruff for checking code quality.'), AlpacaItem(instruction='What are the best practices for using Git in CAMEL?', input='', output='Best practices for using Git in CAMEL include:\\n1. **Commit Often**: Make small, incremental commits with clear messages.\\n2. **Branching**: Use feature branches for new work to keep the main branch stable.'), AlpacaItem(instruction='What should be included in a contribution agreement for CAMEL?', input='', output='A contribution agreement for CAMEL should include:\\n1. **License Grant**: Grant a license for the contribution under Apache 2.0.\\n2. **Attribution**: Ensure contributors are credited for their work.'), AlpacaItem(instruction=\"Explain the significance of the `GitHub Secrets` in CAMEL's development process.\", input='', output=\"`GitHub Secrets` are significant in CAMEL's development process as they securely store sensitive information, such as API keys, which are needed for running tests and deploying the project.\"), AlpacaItem(instruction='What actions should be taken during sprint retrospectives in CAMEL?', input='', output='During sprint retrospectives in CAMEL, the team should:\\n1. **Discuss What Went Well**: Identify successful practices and outcomes.\\n2. **Identify Improvements**: Discuss areas for enhancement for future sprints.'), AlpacaItem(instruction=\"What are the types of labels used in CAMEL's GitHub repository for pull requests?\", input='', output=\"The types of labels used in CAMEL's GitHub repository for pull requests include:\\n1. **feat**: For new features.\\n2. **fix**: For bug fixes.\\n3. **docs**: For documentation updates.\"), AlpacaItem(instruction='Outline the steps for setting up the development environment for CAMEL.', input='', output='To set up the development environment for CAMEL:\\n1. **Clone the Repository**: Use `git clone` to clone the CAMEL repository.\\n2. **Activate Virtual Environment**: Use `poetry shell` to activate the environment.\\n3. **Install Dependencies**: Run `poetry install --with dev,docs -E all` to install necessary packages.'), AlpacaItem(instruction='What are the responsibilities of a CAMEL maintainer?', input='', output='The responsibilities of a CAMEL maintainer include:\\n1. **Review Contributions**: Evaluate pull requests and provide feedback.\\n2. **Manage Issues**: Oversee the issue tracker and prioritize tasks.\\n3. **Facilitate Community Engagement**: Encourage collaboration and communication within the community.'), AlpacaItem(instruction='What principles should guide the design of new features in CAMEL?', input='', output='The principles that should guide the design of new features in CAMEL include:\\n1. **User-Centric**: Design should focus on user needs and experiences.\\n2. **Modular Architecture**: Features should be designed to be modular and easily integrated.'), AlpacaItem(instruction='What is the role of testing in the development of CAMEL?', input='', output='The role of testing in the development of CAMEL is to ensure that code changes do not introduce bugs, verify that features work as intended, and maintain overall code quality.'), AlpacaItem(instruction='Outline the steps for generating code coverage reports in CAMEL.', input='', output='To generate code coverage reports in CAMEL:\\n1. **Run Coverage Commands**: Execute `coverage run --source=. -m pytest .` to run tests with coverage.\\n2. **Generate HTML Report**: Use `coverage html` to create a report viewable in a web browser.'), AlpacaItem(instruction='What should contributors do if they want to suggest improvements to the CAMEL documentation?', input='', output='If contributors want to suggest improvements to the CAMEL documentation, they should:\\n1. **Open an Issue**: Report suggestions as issues in the GitHub repository.\\n2. **Submit a Pull Request**: Make changes directly and submit them for review.'), AlpacaItem(instruction='Describe the importance of the CAMEL community in fostering collaboration.', input='', output='The CAMEL community is important for fostering collaboration as it provides a platform for contributors to share ideas, seek assistance, and work together towards common goals, enhancing the overall development experience.'), AlpacaItem(instruction='What guidelines should be followed when adding new features to CAMEL?', input='', output='When adding new features to CAMEL, guidelines to follow include:\\n1. **Document Thoroughly**: Ensure all new features are well documented.\\n2. **Include Tests**: Provide unit tests to validate the new functionality.'), AlpacaItem(instruction='What are the roles of contributors in the CAMEL project?', input='', output='Roles of contributors in the CAMEL project include:\\n1. **Feature Development**: Implementing new features and enhancements.\\n2. **Bug Fixing**: Identifying and resolving issues in the codebase.\\n3. **Documentation**: Contributing to the documentation for clarity and completeness.'), AlpacaItem(instruction='Explain the process for obtaining feedback on code contributions in CAMEL.', input='', output='The process for obtaining feedback on code contributions in CAMEL includes:\\n1. **Submit a Pull Request**: Open a PR for your changes.\\n2. **Request Reviews**: Tag reviewers to solicit feedback.\\n3. **Address Feedback**: Make necessary changes based on the feedback received.'), AlpacaItem(instruction='Outline the significance of maintaining a changelog in CAMEL.', input='', output='Maintaining a changelog in CAMEL is significant because it provides a clear record of changes, helps users understand what has been added or modified, and facilitates easier tracking of project evolution.'), AlpacaItem(instruction=\"Describe how to access CAMEL's community resources.\", input='', output=\"To access CAMEL's community resources, you can:\\n1. **Join the Discord**: Engage with community members for support and discussions.\\n2. **Visit the GitHub Repository**: Check the repository for documentation and contribution guidelines.\"), AlpacaItem(instruction=\"What steps should be taken to ensure reproducibility in CAMEL's cookbook entries?\", input='', output=\"To ensure reproducibility in CAMEL's cookbook entries:\\n1. **Verify Code Execution**: Ensure that all LLM-generated responses are tested for accuracy.\\n2. **Provide Clear Instructions**: Include step-by-step instructions that users can follow to replicate results.\"), AlpacaItem(instruction='Describe the process of contributing to the CAMEL project.', input='', output=\"To contribute to the CAMEL project, follow these steps:\\n1. **Fork the Repository**: Create a copy of the CAMEL repository on your GitHub account.\\n2. **Clone the Repository**: Clone your forked repository to your local machine using `git clone`.\\n3. **Install Dependencies**: Use `poetry` to install necessary dependencies.\\n4. **Create a Branch**: Make a new branch for your feature or fix.\\n5. **Make Changes**: Implement your changes, ensuring to follow the project's coding standards.\\n6. **Run Tests**: Execute all tests to ensure your changes do not break existing functionality.\\n7. **Commit Changes**: Commit your changes with a descriptive message.\\n8. **Push Changes**: Push your branch back to your GitHub fork.\\n9. **Create a Pull Request**: Open a pull request against the main CAMEL repository.\"), AlpacaItem(instruction='What are the guidelines for contributing to the CAMEL cookbook?', input='', output='The guidelines for contributing to the CAMEL cookbook include:\\n1. **Use the Template**: Follow the provided Google Colab template for consistency.\\n2. **Correctness**: Ensure that all LLM-generated responses are verified with real code execution.\\n3. **Clear Explanations**: Provide clear and concise explanations of the code and its purpose.\\n4. **Interactive Elements**: Add interactive code cells where applicable for hands-on learning.'), AlpacaItem(instruction='Explain the importance of documentation in the CAMEL project.', input='', output='Documentation is crucial in the CAMEL project as it helps users understand how to effectively use the software, contributes to onboarding new developers, and ensures that all contributors maintain a consistent understanding of the codebase and its functionalities.'), AlpacaItem(instruction='What is the role of the `logger` in CAMEL?', input='', output='The `logger` in CAMEL is used for logging events and messages throughout the application. It provides a standardized way to output information, which is crucial for debugging and monitoring the application without cluttering the console output with `print` statements.'), AlpacaItem(instruction='Detail the steps to run unit tests in the CAMEL project.', input='', output='To run unit tests in the CAMEL project, follow these steps:\\n1. **Activate the Virtual Environment**: Use `poetry shell` to activate the environment.\\n2. **Execute Tests**: Run `pytest .` to execute all tests in the project.\\n3. **Check Results**: Review the output to ensure all tests pass successfully.'), AlpacaItem(instruction='What are the communication channels available for CAMEL contributors?', input='', output='The communication channels available for CAMEL contributors include:\\n1. **Discord**: For real-time discussions and support.\\n2. **WeChat**: For Chinese-speaking contributors.\\n3. **Slack**: For team communications and updates.'), AlpacaItem(instruction='Describe the pull request workflow in CAMEL.', input='', output='The pull request workflow in CAMEL involves the following steps:\\n1. **Open a Pull Request**: Link your changes to the relevant issue.\\n2. **Review Process**: Other contributors review the pull request and provide feedback.\\n3. **Address Feedback**: The contributor addresses any comments and makes necessary changes.\\n4. **Approval**: Once approved by at least two reviewers, the pull request can be merged.'), AlpacaItem(instruction='What is the purpose of the `pre-commit` hook in CAMEL?', input='', output='The `pre-commit` hook in CAMEL ensures that every commit is automatically formatted and linted according to project standards, helping maintain code quality and consistency.'), AlpacaItem(instruction='Explain the significance of security checks during code reviews in CAMEL.', input='', output='Security checks during code reviews in CAMEL are significant as they help identify potential vulnerabilities, ensuring that the codebase remains secure and robust against threats and exploits.'), AlpacaItem(instruction='What steps should be taken when a contributor wants to update documentation?', input='', output='When updating documentation in CAMEL, a contributor should:\\n1. **Identify Areas for Improvement**: Review existing documentation for clarity and completeness.\\n2. **Make Edits**: Update the documentation with clear, concise information.\\n3. **Test Documentation**: Ensure that all examples and instructions are accurate.\\n4. **Submit Changes**: Create a pull request with the documentation changes.'), AlpacaItem(instruction='Describe how to handle feedback received during a code review.', input='', output='To handle feedback received during a code review:\\n1. **Read Comments Carefully**: Understand each piece of feedback provided by reviewers.\\n2. **Discuss if Necessary**: If unclear, discuss the feedback with the reviewer for clarity.\\n3. **Make Required Changes**: Update the code as suggested, ensuring all comments are addressed.\\n4. **Respond to Feedback**: Thank reviewers for their input and explain how you addressed their comments.'), AlpacaItem(instruction='What is the role of the CAMEL community in the development process?', input='', output=\"The CAMEL community plays a vital role in the development process by providing feedback, contributing code, suggesting features, and helping with documentation. Their involvement fosters collaboration and innovation, ensuring the project evolves to meet users' needs.\"), AlpacaItem(instruction='Explain the process of writing unit tests for new features in CAMEL.', input='', output='The process of writing unit tests for new features in CAMEL includes:\\n1. **Identify Test Cases**: Determine what aspects of the feature need testing.\\n2. **Write Tests**: Implement tests in the `test` directory, ensuring they cover all scenarios.\\n3. **Run Tests**: Execute the tests using `pytest` to verify that they pass.\\n4. **Integrate Tests**: Ensure that the tests are included in the pull request for the new feature.'), AlpacaItem(instruction='What are the principles to follow when writing code in CAMEL?', input='', output='The principles to follow when writing code in CAMEL include:\\n1. **Readability**: Code should be easy to read and understand.\\n2. **Modularity**: Keep code modular and self-contained.\\n3. **Documentation**: Document code thoroughly to explain its purpose and functionality.'), AlpacaItem(instruction='Describe the significance of the Apache 2.0 license for CAMEL.', input='', output='The Apache 2.0 license is significant for CAMEL as it allows for open-source collaboration while providing protections for both contributors and users. It enables users to freely use, modify, and distribute the software, while ensuring that contributions are recognized.'), AlpacaItem(instruction='What steps should be taken to prepare a feature for a pull request in CAMEL?', input='', output='To prepare a feature for a pull request in CAMEL:\\n1. **Ensure Code Quality**: Review the code for adherence to style guidelines and best practices.\\n2. **Run Tests**: Verify that all tests pass successfully.\\n3. **Document Changes**: Update documentation to reflect new features or changes.\\n4. **Create a Pull Request**: Open a pull request with a clear description of the changes.'), AlpacaItem(instruction='Explain the importance of maintaining a clean codebase in CAMEL.', input='', output='Maintaining a clean codebase in CAMEL is important because it enhances readability, reduces complexity, and makes the code easier to maintain and extend. A clean codebase also helps in preventing bugs and improving overall software quality.'), AlpacaItem(instruction='What are the benefits of using Google Colab for writing the CAMEL cookbook?', input='', output='The benefits of using Google Colab for writing the CAMEL cookbook include:\\n1. **Interactive Environment**: Allows users to run code snippets interactively alongside explanations.\\n2. **Easy Sharing**: Facilitates collaboration and sharing of cookbook entries among contributors.\\n3. **Real-Time Feedback**: Contributors can receive immediate feedback on code execution results.'), AlpacaItem(instruction=\"Describe how to effectively participate in CAMEL's developer meetings.\", input='', output=\"To effectively participate in CAMEL's developer meetings:\\n1. **Prepare in Advance**: Review the agenda and come with any questions or contributions.\\n2. **Engage Actively**: Contribute to discussions and share your insights or feedback.\\n3. **Take Notes**: Document important points and action items discussed during the meeting.\"), AlpacaItem(instruction='What is the purpose of the `coverage` tool in CAMEL?', input='', output='The purpose of the `coverage` tool in CAMEL is to measure the extent to which unit tests cover the codebase, helping to identify areas that may lack sufficient testing and ensuring robust code quality.'), AlpacaItem(instruction='Explain the steps to follow when integrating a new feature into CAMEL.', input='', output='When integrating a new feature into CAMEL, follow these steps:\\n1. **Design the Feature**: Outline how the feature will work and its requirements.\\n2. **Implement the Code**: Write the code for the new feature, adhering to project standards.\\n3. **Test the Feature**: Create and run unit tests to ensure the feature functions correctly.\\n4. **Document the Feature**: Update documentation to include information about the new feature.'), AlpacaItem(instruction='What are the key considerations for writing effective unit tests in CAMEL?', input='', output='Key considerations for writing effective unit tests in CAMEL include:\\n1. **Coverage**: Aim for comprehensive coverage of different scenarios and edge cases.\\n2. **Isolation**: Ensure tests are isolated from external dependencies.\\n3. **Clarity**: Write tests that are easy to understand and maintain, with descriptive names.'), AlpacaItem(instruction='Describe the importance of community feedback in the CAMEL project.', input='', output='Community feedback in the CAMEL project is important as it helps identify areas for improvement, suggests new features, and ensures that the project aligns with user needs and expectations. It fosters a collaborative atmosphere that enhances the quality of the project.'), AlpacaItem(instruction='Outline the process for resolving conflicts during code reviews.', input='', output='To resolve conflicts during code reviews:\\n1. **Identify Conflicts**: Recognize the areas of disagreement in the feedback.\\n2. **Discuss with Reviewers**: Engage with the reviewers to understand their perspectives.\\n3. **Negotiate Solutions**: Propose compromises or alternative solutions that address the concerns.\\n4. **Update Code Accordingly**: Make changes to the code based on the agreed-upon solutions.'), AlpacaItem(instruction='What is the role of `mypy` in the CAMEL project?', input='', output='The role of `mypy` in the CAMEL project is to perform type checking on the codebase, ensuring that type hints are correctly implemented and helping to catch potential type-related errors before runtime.'), AlpacaItem(instruction='Explain the process for submitting documentation updates in CAMEL.', input='', output='To submit documentation updates in CAMEL:\\n1. **Identify the Documentation to Update**: Review existing documentation for accuracy and clarity.\\n2. **Make Edits**: Modify the documentation as needed, ensuring it aligns with current code functionalities.\\n3. **Create a Pull Request**: Submit a pull request with the documentation updates, clearly describing the changes.'), AlpacaItem(instruction='What is the significance of using linting tools in CAMEL?', input='', output='Using linting tools in CAMEL is significant as it helps maintain code quality by enforcing coding standards, identifying potential errors, and improving overall readability, which facilitates collaboration among contributors.'), AlpacaItem(instruction='Describe the process for running pre-commit checks in CAMEL.', input='', output='To run pre-commit checks in CAMEL:\\n1. **Ensure Pre-Commit is Installed**: Verify that the pre-commit hook is set up in your local repository.\\n2. **Run Pre-Commit**: Execute `pre-commit run --all-files` to check all files against the defined hooks.\\n3. **Review Results**: Address any issues identified by the pre-commit checks before making a commit.'), AlpacaItem(instruction='What are the expectations for contributors in terms of coding standards in CAMEL?', input='', output=\"Expectations for contributors regarding coding standards in CAMEL include:\\n1. **Adherence to Style Guidelines**: Follow the project's coding style, including naming conventions and formatting.\\n2. **Writing Clear Code**: Ensure that code is readable and maintainable, with appropriate comments and documentation.\\n3. **Testing Code**: Provide unit tests for new features and ensure all tests pass before submitting code.\"), AlpacaItem(instruction='Explain the importance of issue tracking in the CAMEL project.', input='', output='Issue tracking in the CAMEL project is important as it helps manage bugs, feature requests, and improvements systematically, allowing contributors to prioritize work, monitor progress, and communicate effectively about project needs.'), AlpacaItem(instruction=\"What should contributors do if they encounter outdated issues in CAMEL's issue tracker?\", input='', output=\"If contributors encounter outdated issues in CAMEL's issue tracker, they should:\\n1. **Review the Issue**: Assess whether the issue is still relevant or has been resolved.\\n2. **Comment on the Issue**: Leave a comment to notify maintainers that the issue may be outdated.\\n3. **Close or Update the Issue**: If appropriate, suggest closing the issue or provide an update on its status.\"), AlpacaItem(instruction='Describe the steps for preparing a release in CAMEL.', input='', output='To prepare a release in CAMEL:\\n1. **Gather Changes**: Compile a list of changes, features, and fixes since the last release.\\n2. **Update Versioning**: Increment the version number according to semantic versioning principles.\\n3. **Run Final Tests**: Execute all tests to ensure stability and correctness.\\n4. **Publish Release**: Create a new release via GitHub, including release notes.'), AlpacaItem(instruction='What are the key components of a good pull request description in CAMEL?', input='', output='Key components of a good pull request description in CAMEL include:\\n1. **Title**: A clear and concise title summarizing the changes.\\n2. **Description**: A detailed explanation of what the pull request does and why the changes are necessary.\\n3. **Related Issues**: Links to any related issues or discussions.\\n4. **Testing Instructions**: Information on how to test the changes made.'), AlpacaItem(instruction='Explain the significance of code reviews in maintaining code quality in CAMEL.', input='', output='Code reviews are significant in maintaining code quality in CAMEL as they facilitate knowledge sharing, help catch bugs and potential issues early, ensure adherence to coding standards, and promote collaborative improvement among contributors.'), AlpacaItem(instruction='Describe how to effectively use GitHub Issues for tracking tasks in CAMEL.', input='', output='To effectively use GitHub Issues for tracking tasks in CAMEL:\\n1. **Create Clear Issues**: Write descriptive titles and detailed descriptions for each issue.\\n2. **Assign Labels**: Use labels to categorize issues (e.g., bug, enhancement, question).\\n3. **Assign to Team Members**: Assign issues to team members to clarify responsibilities.\\n4. **Link Related Issues**: Connect related issues to provide context and track dependencies.'), AlpacaItem(instruction='What are the best practices for writing commit messages in CAMEL?', input='', output=\"Best practices for writing commit messages in CAMEL include:\\n1. **Use Imperative Mood**: Write messages in the imperative form (e.g., 'Fix bug' instead of 'Fixed bug').\\n2. **Be Descriptive**: Provide a clear explanation of what the commit does.\\n3. **Limit Line Length**: Keep the first line under 50 characters, followed by a blank line and a more detailed description if necessary.\"), AlpacaItem(instruction='Explain the role of continuous integration in the CAMEL project.', input='', output='Continuous integration in the CAMEL project plays a role in automating the testing and integration of code changes, ensuring that new contributions do not break existing functionality and that the project remains stable and reliable.'), AlpacaItem(instruction='What should contributors consider when writing documentation for CAMEL?', input='', output='When writing documentation for CAMEL, contributors should consider:\\n1. **Clarity**: Ensure that documentation is easy to understand for users of all skill levels.\\n2. **Completeness**: Cover all necessary topics and provide thorough explanations.\\n3. **Examples**: Include practical examples to demonstrate usage and functionality.'), AlpacaItem(instruction='Describe how to participate in sprint planning meetings for CAMEL.', input='', output='To participate in sprint planning meetings for CAMEL:\\n1. **Review Current Issues**: Familiarize yourself with open issues and tasks.\\n2. **Prepare Input**: Be ready to discuss which tasks you can take on during the sprint.\\n3. **Collaborate**: Work with your team to prioritize tasks and set achievable goals for the upcoming sprint.'), AlpacaItem(instruction='What is the significance of using version control in CAMEL?', input='', output='Using version control in CAMEL is significant as it allows for tracking changes, collaborating among multiple contributors, managing code history, and facilitating the rollback of changes if needed, ultimately improving the development workflow.'), AlpacaItem(instruction='Explain the role of automated testing in the CAMEL project.', input='', output='Automated testing in the CAMEL project plays a role in ensuring that code changes do not introduce new bugs, verifying that the software behaves as expected, and providing quick feedback to developers on the impact of their changes.'), AlpacaItem(instruction='What are the benefits of having a diverse contributor base in CAMEL?', input='', output='The benefits of having a diverse contributor base in CAMEL include:\\n1. **Varied Perspectives**: Different backgrounds bring unique insights and ideas to the project.\\n2. **Enhanced Creativity**: Diversity fosters innovation and creative problem-solving.\\n3. **Broader User Base**: A diverse community can help cater to a wider range of users and use cases.'), AlpacaItem(instruction='Describe the process for creating and managing issues in CAMEL.', input='', output=\"The process for creating and managing issues in CAMEL includes:\\n1. **Identify the Problem**: Clearly define the issue or feature request.\\n2. **Create an Issue**: Use GitHub's issue tracker to create a new issue, providing a descriptive title and details.\\n3. **Assign Labels and Milestones**: Categorize the issue using labels and set relevant milestones.\\n4. **Track Progress**: Regularly update the issue status and comment on progress as needed.\"), AlpacaItem(instruction='What are the common pitfalls to avoid when contributing to CAMEL?', input='', output='Common pitfalls to avoid when contributing to CAMEL include:\\n1. **Ignoring Feedback**: Failing to address reviewer comments can lead to delays.\\n2. **Large Pull Requests**: Submitting overly large changes makes reviews difficult.\\n3. **Neglecting Documentation**: Not updating documentation can lead to confusion for users.'), AlpacaItem(instruction='Explain the significance of maintaining a changelog in CAMEL.', input='', output='Maintaining a changelog in CAMEL is significant as it provides a clear record of changes made in each release, helping users and contributors understand what has been added, modified, or fixed, and facilitating better version management.'), AlpacaItem(instruction='What should contributors do if they are unsure about coding standards in CAMEL?', input='', output=\"If contributors are unsure about coding standards in CAMEL, they should:\\n1. **Review Existing Code**: Look at the codebase to see how existing contributors have implemented standards.\\n2. **Consult Documentation**: Check the project's contributing guidelines for specific standards.\\n3. **Ask for Help**: Reach out to maintainers or other contributors for clarification.\"), AlpacaItem(instruction='Describe how to use Git effectively for version control in CAMEL.', input='', output='To use Git effectively for version control in CAMEL:\\n1. **Commit Often**: Make small, frequent commits with clear messages.\\n2. **Branching**: Use branches to work on features or fixes to keep the main branch clean.\\n3. **Merge Carefully**: Use pull requests to merge changes and ensure code quality through reviews.'), AlpacaItem(instruction='What are the key components of the CAMEL development workflow?', input='', output='The key components of the CAMEL development workflow include:\\n1. **Issue Tracking**: Manage tasks and bugs through GitHub Issues.\\n2. **Branching Strategy**: Use branches for features, bugs, and releases.\\n3. **Code Reviews**: Conduct thorough reviews to maintain quality.\\n4. **Continuous Integration**: Automate testing and integration of code changes.'), AlpacaItem(instruction='Explain the role of the CAMEL maintainer.', input='', output=\"The role of the CAMEL maintainer includes overseeing the project's development, reviewing pull requests, providing guidance to contributors, managing releases, and ensuring that the project adheres to its goals and quality standards.\"), AlpacaItem(instruction='What steps should be taken to ensure effective communication within the CAMEL community?', input='', output='To ensure effective communication within the CAMEL community:\\n1. **Use Designated Channels**: Engage in discussions on Discord, Slack, or WeChat as appropriate.\\n2. **Be Respectful and Constructive**: Encourage a positive and supportive atmosphere.\\n3. **Share Updates Regularly**: Keep the community informed about project progress and developments.'), AlpacaItem(instruction='What should I do if I encounter an issue while setting up the CAMEL project?', input='', output='If you encounter an issue while setting up the CAMEL project, you should reach out to a maintainer for assistance. The team is committed to ensuring a smooth setup experience for all contributors. If you find any specific guidelines for code linting, formatting, or documentation to be challenging, do not hesitate to ask for help.'), AlpacaItem(instruction='How can I contribute to the CAMEL documentation?', input='', output=\"To contribute to the CAMEL documentation, you should provide comprehensive documentation for all classes and methods. The documentation is primarily generated using Sphinx, so ensure that your contributions are clear, concise, and follow the project's guidelines. You can also build the documentation locally to verify that everything displays correctly.\"), AlpacaItem(instruction='Explain the guidelines for writing docstrings in CAMEL.', input='', output='The guidelines for writing docstrings in CAMEL include:\\n1. Use triple-quoted strings with `r\"\"\"` to prevent issues with special characters.\\n2. Provide a brief description of the class or method\\'s purpose.\\n3. Document parameters in an `Args:` section, including name, type, description, and default values.'), AlpacaItem(instruction='What are the steps to create a pull request in CAMEL?', input='', output='To create a pull request in CAMEL, follow these steps:\\n1. Go to the GitHub Pulls page and create a new PR.\\n2. Choose the branch you want to merge into and fill in the required information, linking any related issue.\\n3. Ensure your PR has a proper title and update the Reviewers, Assignees, Labels, and Milestones.\\n4. Move the PR through the stages: Developing, Stuck, Reviewing, and Merged.'), AlpacaItem(instruction='How do I ensure code quality during reviews in CAMEL?', input='', output=\"To ensure code quality during reviews in CAMEL:\\n1. Reviewers should check for functionality, readability, consistency, and compliance with the project's coding standards.\\n2. Provide constructive feedback on any necessary changes.\\n3. Ensure that the code is approved by at least two reviewers before merging.\"), AlpacaItem(instruction='What is the process for contributing to the CAMEL Cookbook?', input='', output='To contribute to the CAMEL Cookbook, follow these steps:\\n1. Use the provided template to maintain consistency in style and structure.\\n2. Write your entries in Google Colab, ensuring correctness and clear explanations.\\n3. Review the draft in Colab, addressing any feedback before submitting.'), AlpacaItem(instruction=\"Describe how to manage issues in CAMEL's GitHub repository.\", input='', output=\"To manage issues in CAMEL's GitHub repository, regularly check the issues page for bugs, improvements, and feature requests. Assign issues to yourself when working on them and keep them focused on specific topics. Link related issues rather than merging them into one. Discuss issues during team meetings and update their status as needed.\"), AlpacaItem(instruction='What are the common pitfalls to avoid during code reviews?', input='', output='Common pitfalls to avoid during code reviews include:\\n1. Submitting large PRs; instead, break them into smaller, manageable ones.\\n2. Ignoring feedback from reviewers; always address feedback or discuss it.\\n3. Rushing through reviews; take the time to thoroughly check the code.'), AlpacaItem(instruction='How can I ensure high-quality contributions to the CAMEL project?', input='', output='To ensure high-quality contributions to the CAMEL project, follow these principles:\\n1. Write clear and maintainable code with proper documentation.\\n2. Conduct thorough testing and include unit tests where applicable.\\n3. Maintain consistent style and adhere to project guidelines.'), AlpacaItem(instruction='What is the significance of using `logger` instead of `print` in CAMEL?', input='', output='Using `logger` instead of `print` in CAMEL is significant because it ensures consistent, configurable, and professional logging. It allows for different logging levels (info, debug, etc.) and better control over logging output, which is essential for maintaining code quality and debugging.'), AlpacaItem(instruction='Explain the importance of documentation in CAMEL.', input='', output='Documentation is crucial in CAMEL as it helps users understand how to use the project effectively. It ensures that all classes and methods are well-described, making it easier for new contributors to onboard and for existing users to utilize the features correctly.'), AlpacaItem(instruction='What steps should be followed for sprint planning in CAMEL?', input='', output='The steps for sprint planning in CAMEL include:\\n1. Define the sprint duration, typically two weeks for development.\\n2. Conduct a planning meeting where the founder outlines the sprint goal.\\n3. Developers select items from the backlog to work on during the sprint.'), AlpacaItem(instruction='How do I run tests in the CAMEL project?', input='', output='To run tests in the CAMEL project, activate the virtual environment using `poetry shell`, then execute `pytest .` to run all tests. Review the output to ensure all tests pass successfully.'), AlpacaItem(instruction='What are the principles to follow when writing code for CAMEL?', input='', output='The principles to follow when writing code for CAMEL include:\\n1. Clarity: Use descriptive names and avoid abbreviations.\\n2. Documentation: Ensure public methods and complex logic are well-documented.\\n3. Modularity: Write modular code to promote reusability.'), AlpacaItem(instruction='How can I update dependencies in the CAMEL project?', input='', output='To update dependencies in the CAMEL project, modify the `pyproject.toml` file, then run `poetry lock` to synchronize changes. This ensures that the lock file is updated with the latest dependencies.'), AlpacaItem(instruction='What is the process for submitting a cookbook to CAMEL?', input='', output='To submit a cookbook to CAMEL:\\n1. Write your content in Google Colab using the designated template.\\n2. Review the draft in Colab and address any feedback received.\\n3. Download the finalized notebook as a .ipynb file and create a pull request to add it to the repository.'), AlpacaItem(instruction='Describe the steps to build documentation for CAMEL locally.', input='', output='To build documentation for CAMEL locally:\\n1. Navigate to the `docs` directory in your terminal.\\n2. Run the command `make html` to generate the HTML documentation.'), AlpacaItem(instruction='What is the role of code reviews in the CAMEL project?', input='', output='Code reviews in the CAMEL project play a vital role in maintaining code quality, facilitating knowledge sharing, preventing bugs, and ensuring consistency in style and design patterns across the codebase.'), AlpacaItem(instruction='How do I ensure reproducibility in the CAMEL cookbook?', input='', output='To ensure reproducibility in the CAMEL cookbook, verify that all code entries are correct and can be executed successfully. Users should be able to replicate results by following the provided steps without discrepancies.'), AlpacaItem(instruction='What is the significance of the `Args` section in docstrings?', input='', output='The `Args` section in docstrings is significant because it documents the parameters of a function or method clearly. It includes the parameter name, type, description, and any default values, helping users understand how to use the function correctly.'), AlpacaItem(instruction='What should I include in a pull request description?', input='', output='In a pull request description, include:\\n1. A clear title summarizing the changes.\\n2. A detailed explanation of what the PR does and why it is necessary.\\n3. References to any related issues and relevant documentation.'), AlpacaItem(instruction='Explain the process for reviewing a cookbook submission in CAMEL.', input='', output='The process for reviewing a cookbook submission in CAMEL involves:\\n1. Reviewing the draft in Google Colab, focusing on accuracy and clarity.\\n2. Providing comments and suggestions directly in the Colab document.\\n3. Ensuring the final draft meets quality standards before integration.'), AlpacaItem(instruction='How do I handle feedback received during code reviews?', input='', output='When receiving feedback during code reviews, address all comments constructively. If you agree with the feedback, make the necessary changes. If you disagree, discuss your reasoning with the reviewer to reach a mutual understanding.'), AlpacaItem(instruction='What are the benefits of joining the CAMEL community?', input='', output='Joining the CAMEL community offers benefits such as:\\n1. Access to a network of contributors and maintainers for support and collaboration.\\n2. Opportunities to learn about best practices in open-source development.\\n3. Engagement in discussions about project direction and feature development.'), AlpacaItem(instruction='Describe the importance of testing in the CAMEL project.', input='', output='Testing is important in the CAMEL project because it ensures the reliability and correctness of the code. It helps catch bugs early, provides confidence in changes, and facilitates maintenance by ensuring that new contributions do not break existing functionality.'), AlpacaItem(instruction='How can I participate in developer meetings for CAMEL?', input='', output='To participate in developer meetings for CAMEL, check the meeting schedule provided in the documentation and join via the specified communication platform, such as Discord for English speakers or Tencent Meeting for Chinese speakers.'), AlpacaItem(instruction='What should I do before submitting a pull request?', input='', output=\"Before submitting a pull request, ensure that:\\n1. Your code is properly formatted and adheres to the project's style guidelines.\\n2. All tests pass successfully.\\n3. You have reviewed the code for clarity and correctness.\"), AlpacaItem(instruction='What are the common actions to take when contributing to CAMEL?', input='', output='Common actions to take when contributing to CAMEL include:\\n1. Cloning the repository and setting up the development environment.\\n2. Creating and managing issues and pull requests.\\n3. Engaging with the community through discussions and meetings.'), AlpacaItem(instruction='How do I ensure that my contributions are recognized in CAMEL?', input='', output='To ensure your contributions are recognized in CAMEL, mention your Twitter handle in your pull request if you would like to be credited. The team is happy to acknowledge your work publicly.'), AlpacaItem(instruction='What is the purpose of using GitHub Secrets in CAMEL?', input='', output='The purpose of using GitHub Secrets in CAMEL is to securely store sensitive information, such as API keys, that are needed for testing and deployment. This ensures that the sensitive data is not exposed in the codebase.'), AlpacaItem(instruction='Explain the significance of sprint reviews in the CAMEL project.', input='', output='Sprint reviews in the CAMEL project are significant because they provide stakeholders with an opportunity to review the delivered features, give feedback, and identify areas for improvement in future sprints.'), AlpacaItem(instruction='What should I do if I want to propose a new feature for CAMEL?', input='', output=\"If you want to propose a new feature for CAMEL, create an issue on the GitHub repository outlining your proposal. Be sure to provide detailed information about the feature's purpose, benefits, and any relevant context.\"), AlpacaItem(instruction=\"How do I ensure my contributions meet the project's standards?\", input='', output=\"To ensure your contributions meet the project's standards, familiarize yourself with the contribution guidelines, follow best practices for coding and documentation, and actively seek feedback from maintainers and the community.\"), AlpacaItem(instruction='What is the role of the CAMEL community in development?', input='', output=\"The role of the CAMEL community in development is to collaborate on improving the project, share knowledge and resources, provide support to new contributors, and engage in discussions about the project's direction and goals.\"), AlpacaItem(instruction='How can I improve the documentation for CAMEL?', input='', output='To improve the documentation for CAMEL, review existing content for clarity and accuracy, suggest new examples, and ensure that all classes and methods are well-documented. You can also request feedback from the community.'), AlpacaItem(instruction='What should I include in my feature request for CAMEL?', input='', output=\"In your feature request for CAMEL, include a clear title, a detailed description of the feature's purpose and functionality, any potential use cases, and how it would benefit the project or its users.\"), AlpacaItem(instruction='Explain how to handle multiple pull requests in CAMEL.', input='', output=\"To handle multiple pull requests in CAMEL, ensure each PR is focused on a single topic or issue. Review them in a timely manner, provide feedback, and merge them as they pass review and meet the project's standards.\"), AlpacaItem(instruction='How can I contribute to enhancing the testing framework in CAMEL?', input='', output='To contribute to enhancing the testing framework in CAMEL, identify areas for improvement or additional test coverage, write new tests, and ensure that existing tests are updated as needed. Submit your changes via a pull request.'), AlpacaItem(instruction='What are the best practices for writing unit tests in CAMEL?', input='', output='Best practices for writing unit tests in CAMEL include:\\n1. Ensure comprehensive coverage of different scenarios and edge cases.\\n2. Write clear and descriptive test names.\\n3. Isolate tests from external dependencies to ensure reliability.'), AlpacaItem(instruction='How do I verify the correctness of my contributions before submission?', input='', output='To verify the correctness of your contributions before submission, run all relevant tests, ensure that your code passes linting and formatting checks, and review your documentation for clarity and completeness.'), AlpacaItem(instruction='What are the key communication channels for the CAMEL community?', input='', output='The key communication channels for the CAMEL community include Discord for real-time discussions, WeChat for Chinese speakers, and Slack for general collaboration and updates.'), AlpacaItem(instruction='How can I participate in discussions about project direction in CAMEL?', input='', output='To participate in discussions about project direction in CAMEL, engage in community meetings, contribute to discussions on Discord or Slack, and provide feedback on proposals and ideas shared by maintainers.'), AlpacaItem(instruction='What should I do if I want to withdraw my contribution to CAMEL?', input='', output=\"If you want to withdraw your contribution to CAMEL, communicate with the maintainers through the relevant communication channel to inform them of your decision. If it's a pending pull request, you can close it on GitHub.\"), AlpacaItem(instruction='How do I manage dependencies in the CAMEL project?', input='', output='To manage dependencies in the CAMEL project, use the `pyproject.toml` file to add, update, or remove dependencies. After making changes, run `poetry lock` to synchronize the lock file.'), AlpacaItem(instruction='Describe the purpose of the `test` directory in CAMEL.', input='', output=\"The `test` directory in CAMEL is designated for unit tests that cover the functionality of the project's code. It ensures that all components work as expected and helps maintain code quality.\"), AlpacaItem(instruction='What is the process for updating documentation in CAMEL?', input='', output='The process for updating documentation in CAMEL involves reviewing existing content for accuracy, making necessary changes or additions, and submitting those updates through a pull request for review.'), AlpacaItem(instruction='How can I support the CAMEL project without coding?', input='', output='You can support the CAMEL project without coding by helping with documentation, providing feedback on features and usability, engaging in community discussions, and promoting the project within your network.'), AlpacaItem(instruction='What is the significance of using semantic versioning in CAMEL?', input='', output='The significance of using semantic versioning in CAMEL is to communicate changes clearly to users. It indicates whether a release includes backward-compatible changes, new features, or breaking changes, helping maintainers and users manage expectations.'), AlpacaItem(instruction='How do I run coverage reports for tests in CAMEL?', input='', output='To run coverage reports for tests in CAMEL, use the command `coverage run --source=. -m pytest .` to execute the tests with coverage tracking, and then generate the report using `coverage html` to view the results in a browser.'), AlpacaItem(instruction='What should I do if I find a bug in CAMEL?', input='', output='If you find a bug in CAMEL, create an issue on the GitHub repository detailing the bug, including steps to reproduce it, the expected behavior, and any relevant context. This helps the maintainers address the issue effectively.'), AlpacaItem(instruction='Describe the guidelines for contributing to the CAMEL project.', input='', output='The guidelines for contributing to the CAMEL project include:\\n- Following the Fork-and-Pull-Request workflow for opening pull requests if you are a community contributor.\\n- Ensuring that your contributions are well-documented and tested.\\n- Joining the CAMEL community through Discord for better communication.'), AlpacaItem(instruction='What is the significance of using Google Colab for cookbook contributions?', input='', output='Using Google Colab for cookbook contributions is significant because it allows contributors to run interactive code and include explanations side-by-side, which is ideal for creating a practical, hands-on cookbook that users can easily follow.'), AlpacaItem(instruction='What should a contributor do before submitting a pull request?', input='', output='Before submitting a pull request, a contributor should:\\n1. Ensure the code passes all formatting, linting, and testing checks.\\n2. Mention any related issues and tag the relevant maintainers.\\n3. Review the changes to ensure clarity and correctness.'), AlpacaItem(instruction='Explain how to document parameters in function docstrings in CAMEL.', input='', output=\"To document parameters in function docstrings in CAMEL, use an `Args:` section that includes:\\n- The parameter name matching the function signature.\\n- The type of the parameter.\\n- A brief description of the parameter's role.\\n- Default values indicated with (default: :obj:<default_value>).\"), AlpacaItem(instruction='What is the process of reviewing a cookbook contribution in CAMEL?', input='', output='The process of reviewing a cookbook contribution in CAMEL includes:\\n1. Reviewing the draft in Google Colab and leaving comments directly in the document.\\n2. Focusing on accuracy, clarity, structure, and formatting.\\n3. Providing feedback for improvement and ensuring that the entry meets quality standards.'), AlpacaItem(instruction='What is the purpose of the Code Review Checklist in CAMEL?', input='', output='The purpose of the Code Review Checklist in CAMEL is to maintain high code quality by ensuring that:\\n- The functionality is correct and edge cases are handled.\\n- Code readability and maintainability are upheld.\\n- Documentation and design consistency are verified.'), AlpacaItem(instruction='Outline the steps to submit a cookbook once it is ready for integration.', input='', output='To submit a cookbook once it is ready for integration:\\n1. Download the finalized Colab notebook as a .ipynb file.\\n2. Create a pull request to add the cookbook to the docs folder of the repository.\\n3. Include necessary documentation or references to integrate the cookbook into the main docs.'), AlpacaItem(instruction='What principles should be followed when writing cookbook entries?', input='', output='When writing cookbook entries, contributors should follow principles such as:\\n- Ensuring high quality with accurate code and explanations.\\n- Validating any LLM-generated responses with real-world examples.\\n- Making the content accessible to users of varying skill levels.'), AlpacaItem(instruction='How can contributors ensure reproducibility in the CAMEL cookbook?', input='', output='Contributors can ensure reproducibility in the CAMEL cookbook by:\\n- Writing code that consistently produces the same results when run.\\n- Providing clear instructions and context for users to replicate the outcomes.'), AlpacaItem(instruction='What are the steps for engaging with issues on the CAMEL GitHub page?', input='', output='To engage with issues on the CAMEL GitHub page:\\n1. Visit the issues page and browse existing issues.\\n2. Create a new issue focusing on a specific bug, improvement, or feature.\\n3. Assign the issue to yourself if you plan to work on it.'), AlpacaItem(instruction='Explain the role of logging in CAMEL and how it should be implemented.', input='', output=\"The role of logging in CAMEL is to provide consistent, configurable, and professional logging instead of using print statements. Contributors should use Python's logging module (logger) to log important events and debug information.\"), AlpacaItem(instruction='What are the best practices for running tests in CAMEL?', input='', output='Best practices for running tests in CAMEL include:\\n- Using the command `pytest .` to run all tests, including those that require API keys.\\n- Running only local isolated tests with `pytest --fast-test-mode .` when developing.'), AlpacaItem(instruction='What should be included in the documentation for a new feature in CAMEL?', input='', output='Documentation for a new feature in CAMEL should include:\\n- A clear description of the feature and its purpose.\\n- Usage examples and any relevant parameters or configurations.\\n- Tests that validate the functionality of the feature.'), AlpacaItem(instruction='Describe the importance of maintaining a clean codebase in CAMEL.', input='', output='Maintaining a clean codebase in CAMEL is important to:\\n- Ensure readability and maintainability for current and future contributors.\\n- Facilitate easier debugging and prevent potential bugs.\\n- Promote collaboration and knowledge sharing among contributors.'), AlpacaItem(instruction='What guidelines should be followed when contributing to documentation in CAMEL?', input='', output='When contributing to documentation in CAMEL, guidelines include:\\n- Providing comprehensive documentation for all classes and methods.\\n- Ensuring that the documentation is clear, concise, and structured.'), AlpacaItem(instruction='Explain the significance of using the `pre-commit` hook in CAMEL.', input='', output=\"The significance of using the `pre-commit` hook in CAMEL is that it automatically formats and lints code before every commit, ensuring that all contributions adhere to the project's coding standards and reducing the likelihood of introducing errors.\"), AlpacaItem(instruction='What is the role of the CAMEL community in contributing to the project?', input='', output='The role of the CAMEL community in contributing to the project includes:\\n- Providing feedback and suggestions for improvements.\\n- Collaborating on new features and bug fixes.\\n- Sharing knowledge and resources to help new contributors onboard.'), AlpacaItem(instruction='Outline the process for managing pull requests in CAMEL.', input='', output='The process for managing pull requests in CAMEL includes:\\n1. Creating a new PR with a proper title and linking to related issues.\\n2. Conducting reviews and providing feedback.\\n3. Merging the PR once approved by at least two reviewers.'), AlpacaItem(instruction='What is the purpose of the CAMEL contribution template?', input='', output='The purpose of the CAMEL contribution template is to provide a standardized format for contributors to follow, ensuring that all necessary information is included and that contributions are consistent and easy to review.'), AlpacaItem(instruction=\"Describe the steps to participate in CAMEL's developer meetings.\", input='', output=\"To participate in CAMEL's developer meetings:\\n1. Join the specified Discord channel for your language group.\\n2. Attend the meetings on the designated day and time.\\n3. Contribute to discussions and share updates on your work.\"), AlpacaItem(instruction='What is the importance of having a comprehensive README in the CAMEL repository?', input='', output='Having a comprehensive README in the CAMEL repository is important because it provides essential information about the project, including installation instructions, usage examples, contribution guidelines, and links to documentation, helping new users and contributors understand the project quickly.'), AlpacaItem(instruction='How should contributors handle feedback received during code reviews?', input='', output='Contributors should handle feedback received during code reviews by:\\n- Addressing all comments constructively, even if they disagree.\\n- Making the necessary changes to improve the code based on feedback.\\n- Engaging in discussions to clarify any misunderstandings.'), AlpacaItem(instruction='Outline the steps to update dependencies in CAMEL.', input='', output='To update dependencies in CAMEL:\\n1. Modify the `pyproject.toml` file to add, update, or delete dependencies.\\n2. Run `poetry lock` to synchronize the changes with the lock file.'), AlpacaItem(instruction='What should contributors do if they encounter issues during the setup process?', input='', output='If contributors encounter issues during the setup process, they should:\\n- Reach out to a maintainer for assistance.\\n- Consult the documentation for troubleshooting tips.\\n- Provide details about the issue to facilitate a quicker resolution.'), AlpacaItem(instruction='Explain how to run coverage tests in CAMEL.', input='', output='To run coverage tests in CAMEL:\\n1. Use the command `coverage run --source=. -m pytest .` to measure code coverage.\\n2. Generate a report with `coverage html` to view detailed coverage results.'), AlpacaItem(instruction='What are the key elements to include in unit tests for CAMEL?', input='', output='Key elements to include in unit tests for CAMEL are:\\n- Test cases that cover different scenarios and edge cases.\\n- Assertions that validate the expected outcomes of the code.\\n- Clear documentation of the purpose of each test.'), AlpacaItem(instruction='Describe the process for integrating new features into CAMEL.', input='', output='The process for integrating new features into CAMEL involves:\\n1. Developing the feature and ensuring it is well-tested.\\n2. Documenting the feature and updating any relevant examples.\\n3. Submitting a pull request for review and integration.'), AlpacaItem(instruction=\"What should contributors do to ensure their code adheres to CAMEL's style guidelines?\", input='', output=\"To ensure their code adheres to CAMEL's style guidelines, contributors should:\\n- Use the `ruff` tool for linting and formatting checks.\\n- Review the Google Python Style Guide for reference.\"), AlpacaItem(instruction=\"What steps should be followed to join CAMEL's Slack community?\", input='', output=\"To join CAMEL's Slack community, follow these steps:\\n1. Access the invitation link provided for Slack.\\n2. Create an account or log in if you already have one.\\n3. Introduce yourself in the relevant channels.\"), AlpacaItem(instruction=\"What are the benefits of participating in CAMEL's Discord community?\", input='', output=\"The benefits of participating in CAMEL's Discord community include:\\n- Real-time communication with other contributors and maintainers.\\n- Access to updates and discussions about the project.\\n- Opportunities for collaboration and networking.\"), AlpacaItem(instruction='How can contributors ensure that their pull requests are ready for review?', input='', output='Contributors can ensure that their pull requests are ready for review by:\\n- Completing all required tests and documentation.\\n- Ensuring the code passes linting and formatting checks.\\n- Providing a clear description of the changes made.'), AlpacaItem(instruction=\"Explain the importance of issue linking in CAMEL's development process.\", input='', output=\"The importance of issue linking in CAMEL's development process lies in:\\n- Providing context for changes made in a pull request.\\n- Facilitating better tracking of related issues and features.\\n- Enhancing collaboration and communication among contributors.\"), AlpacaItem(instruction='What should be included in the documentation for a bug fix in CAMEL?', input='', output='Documentation for a bug fix in CAMEL should include:\\n- A clear description of the bug and how it was identified.\\n- Steps taken to resolve the issue, including code changes.\\n- Tests added to ensure the bug does not recur.'), AlpacaItem(instruction='Outline the steps for building documentation locally in CAMEL.', input='', output='To build documentation locally in CAMEL:\\n1. Navigate to the `docs` directory.\\n2. Use the command `make html` to generate the HTML documentation.'), AlpacaItem(instruction='What is the purpose of the CAMEL license, and how should it be applied?', input='', output='The purpose of the CAMEL license (Apache 2.0) is to define the terms under which the source code can be used, modified, and distributed. Contributors should apply the license by including it at the top of their files or using the provided script to automate the process.'), AlpacaItem(instruction='Describe how contributors can give credit for their work in CAMEL.', input='', output='Contributors can give credit for their work in CAMEL by:\\n- Notifying maintainers if they want recognition on social media.\\n- Ensuring their contributions are documented in release notes.'), AlpacaItem(instruction='What steps should contributors take when creating a new issue in CAMEL?', input='', output='When creating a new issue in CAMEL, contributors should:\\n1. Provide a clear and descriptive title for the issue.\\n2. Fill in all required fields with relevant information.\\n3. Tag appropriate labels to categorize the issue.'), AlpacaItem(instruction='How can contributors participate in sprint planning and reviews in CAMEL?', input='', output='Contributors can participate in sprint planning and reviews in CAMEL by attending biweekly meetings, discussing priorities, and providing feedback on completed work.'), AlpacaItem(instruction='What is the procedure for updating the CAMEL documentation?', input='', output='The procedure for updating the CAMEL documentation includes:\\n1. Reviewing the current documentation for accuracy.\\n2. Making necessary changes and improvements.\\n3. Submitting a pull request with the updated documentation.'), AlpacaItem(instruction='What are the main communication channels for CAMEL contributors?', input='', output='The main communication channels for CAMEL contributors include:\\n- Discord for real-time discussions.\\n- Slack for collaboration and updates.\\n- WeChat for Chinese-speaking contributors.'), AlpacaItem(instruction='Explain how to handle multiple accounts when contributing to CAMEL.', input='', output='To handle multiple accounts when contributing to CAMEL, contributors should:\\n- Sign out of other accounts in all tabs before signing in.\\n- Ensure they are using the correct account when submitting pull requests.'), AlpacaItem(instruction='What is the significance of keeping issues up to date in CAMEL?', input='', output='The significance of keeping issues up to date in CAMEL is to ensure that contributors are aware of the current status of tasks, preventing confusion and enabling efficient workflow.'), AlpacaItem(instruction='Outline the steps for conducting effective code reviews in CAMEL.', input='', output='To conduct effective code reviews in CAMEL:\\n1. Review code for functionality, readability, and compliance with standards.\\n2. Provide constructive feedback and suggestions for improvement.\\n3. Ensure the contributor addresses feedback before approving.'), AlpacaItem(instruction='What should be done if a contributor discovers a security vulnerability in CAMEL?', input='', output='If a contributor discovers a security vulnerability in CAMEL, they should:\\n- Report the issue immediately to the maintainers through private channels.\\n- Avoid disclosing the vulnerability publicly until it has been addressed.'), AlpacaItem(instruction='Describe the process for merging pull requests in CAMEL.', input='', output='The process for merging pull requests in CAMEL includes:\\n1. Ensuring at least two reviewers have approved the code.\\n2. Verifying that all tests have passed successfully.\\n3. Merging the PR into the main branch by an authorized contributor.'), AlpacaItem(instruction='How should contributors approach documentation updates for new features?', input='', output='Contributors should approach documentation updates for new features by:\\n- Writing clear and concise descriptions of the feature.\\n- Including examples and usage instructions.\\n- Ensuring the documentation is integrated into the main docs appropriately.'), AlpacaItem(instruction='What is the purpose of the CAMEL community guidelines?', input='', output='The purpose of the CAMEL community guidelines is to foster a welcoming and inclusive environment for contributors, outlining expectations for behavior and collaboration within the project.'), AlpacaItem(instruction='What should contributors do if they are unable to address feedback in a timely manner?', input='', output='If contributors are unable to address feedback in a timely manner, they should:\\n- Communicate with the reviewers about the delay.\\n- Provide an estimated timeline for when they can respond to the feedback.'), AlpacaItem(instruction=\"Outline the importance of unit testing in CAMEL's development process.\", input='', output=\"Unit testing is important in CAMEL's development process because it helps:\\n- Ensure code correctness and functionality.\\n- Catch bugs early in the development cycle.\\n- Provide documentation for expected behavior of the code.\"), AlpacaItem(instruction='What are the benefits of using a structured workflow for issue creation in CAMEL?', input='', output='The benefits of using a structured workflow for issue creation in CAMEL include:\\n- Improved organization and tracking of tasks.\\n- Enhanced clarity for contributors about what needs to be done.\\n- Streamlined communication regarding project priorities.'), AlpacaItem(instruction='What are the steps for joining the CAMEL community?', input='', output='To join the CAMEL community, you can:\\n1. **Join Discord**: Access the community on Discord for discussions and support.\\n2. **Schedule an Introduction Call**: Use the provided Calendly links for English or Chinese speakers to schedule a call with the community leaders.\\n3. **Engage with the Project**: Start exploring the project by reviewing the repository and contributing.'), AlpacaItem(instruction='Explain the Fork-and-Pull-Request workflow for contributors.', input='', output='The Fork-and-Pull-Request workflow involves:\\n1. **Fork the Repository**: Create a personal copy of the CAMEL repository on GitHub.\\n2. **Make Changes**: Implement your changes in a new branch in your fork.\\n3. **Create a Pull Request**: Once changes are ready, submit a pull request to the original repository, detailing your changes and linking any relevant issues.'), AlpacaItem(instruction='Describe the process for reviewing code contributions in CAMEL.', input='', output='The code review process in CAMEL involves:\\n1. **Reviewer Checks**: Reviewers examine the code for functionality, readability, and adherence to coding standards.\\n2. **Constructive Feedback**: Provide clear, constructive feedback to the contributor.\\n3. **Approval**: Once the code meets the necessary criteria, it can be approved and merged into the main branch by a maintainer.'), AlpacaItem(instruction='What guidelines should be followed when writing docstrings in CAMEL?', input='', output='When writing docstrings in CAMEL, follow these guidelines:\\n1. **Use Triple Quotes**: Begin with `r\"\"\"` for raw strings.\\n2. **Brief Description**: Start with a concise summary of the class or method.\\n3. **Document Parameters**: Use an `Args` section to detail parameters, including type and default values.'), AlpacaItem(instruction='What steps should be taken to ensure code quality in CAMEL?', input='', output=\"To ensure code quality in CAMEL, contributors should:\\n1. **Follow Coding Standards**: Adhere to the project's coding style guidelines.\\n2. **Write Unit Tests**: Include unit tests for new features and bug fixes.\\n3. **Conduct Code Reviews**: Participate in code reviews to catch potential issues before merging.\"), AlpacaItem(instruction='Outline the process for submitting a cookbook contribution.', input='', output='The process for submitting a cookbook contribution includes:\\n1. **Writing**: Use the provided template in Google Colab to draft your entry.\\n2. **Review**: Submit for review within Colab, where feedback will be provided.\\n3. **Submit**: Once finalized, download the .ipynb file and create a pull request to add it to the documentation.'), AlpacaItem(instruction='What is the significance of using the `logger` instead of `print` statements?', input='', output='Using the `logger` instead of `print` statements is significant because:\\n1. **Consistency**: It provides a uniform logging approach across the application.\\n2. **Configurability**: Loggers can be configured to output messages at different levels (e.g., info, debug).\\n3. **Professionalism**: It enhances the professionalism of the codebase by using standard logging practices.'), AlpacaItem(instruction='Explain how to build documentation locally for CAMEL.', input='', output='To build documentation locally for CAMEL:\\n1. **Navigate to Docs**: Change directory to the `docs` folder.\\n2. **Run Build Command**: Execute the command `make html` to generate HTML documentation.\\n3. **View Documentation**: Open the generated HTML files to review the documentation locally.'), AlpacaItem(instruction='What should contributors do if they want to fix a bug in CAMEL?', input='', output='If contributors want to fix a bug in CAMEL, they should:\\n1. **Identify the Bug**: Locate the issue on GitHub and confirm its existence.\\n2. **Fork and Clone**: Fork the repository and clone it to their local machine.\\n3. **Implement Fix**: Make the necessary changes and add relevant unit tests.\\n4. **Create a Pull Request**: Submit a pull request with a description of the changes made.'), AlpacaItem(instruction='What are the principles to follow when writing cookbook entries?', input='', output='When writing cookbook entries, follow these principles:\\n1. **High Quality**: Ensure that the content is accurate and well-documented.\\n2. **Reproducibility**: Code should be reproducible, allowing users to achieve the same results.\\n3. **Accessibility**: Content should be accessible to a range of users, from beginners to experts.'), AlpacaItem(instruction='How can contributors keep track of issues in CAMEL?', input='', output='Contributors can keep track of issues in CAMEL by:\\n1. **Monitoring GitHub Issues Page**: Regularly check the issues page for updates.\\n2. **Assigning Issues**: Assign issues to themselves when they start working on them.\\n3. **Linking Related Issues**: Use links to connect related issues for better organization.'), AlpacaItem(instruction='What should contributors do if they want to add a new feature?', input='', output='If contributors want to add a new feature, they should:\\n1. **Discuss the Feature**: Bring up the idea in community meetings or on Discord.\\n2. **Fork the Repository**: Create a fork of the CAMEL repository.\\n3. **Implement the Feature**: Develop the feature and ensure to include relevant tests and documentation.\\n4. **Submit a Pull Request**: Open a pull request detailing the new feature and its benefits.'), AlpacaItem(instruction='What is the purpose of the CAMEL sprint review?', input='', output='The purpose of the CAMEL sprint review is to:\\n1. **Showcase Work**: Present the features and improvements completed during the sprint.\\n2. **Gather Feedback**: Collect feedback from stakeholders to identify areas for improvement.\\n3. **Plan Next Steps**: Discuss the outcomes and plan for the next sprint based on feedback received.'), AlpacaItem(instruction='Describe the role of a maintainer in CAMEL.', input='', output='The role of a maintainer in CAMEL includes:\\n1. **Merging Pull Requests**: Review and merge contributions from the community.\\n2. **Guiding Contributors**: Provide support and guidance to new contributors.\\n3. **Maintaining Code Quality**: Ensure that the codebase remains clean and adheres to project standards.'), AlpacaItem(instruction='What tools are recommended for testing in CAMEL?', input='', output='The recommended tools for testing in CAMEL include:\\n1. **pytest**: For running unit tests and integration tests.\\n2. **coverage**: To measure code coverage and identify untested areas.\\n3. **mypy**: For type checking and ensuring type safety in the codebase.'), AlpacaItem(instruction='Explain the significance of using consistent naming conventions in CAMEL.', input='', output='Using consistent naming conventions in CAMEL is significant because:\\n1. **Readability**: Clear and descriptive names improve code readability.\\n2. **Maintainability**: Consistent names make it easier to maintain and update code.\\n3. **Clarity**: Avoids ambiguity, ensuring that code is understandable for both developers and AI agents.'), AlpacaItem(instruction='What is the process for updating dependencies in CAMEL?', input='', output='The process for updating dependencies in CAMEL includes:\\n1. **Modify `pyproject.toml`**: Add, update, or delete dependencies as needed.\\n2. **Run Poetry Lock**: Execute `poetry lock` to synchronize the dependencies with the lock file.\\n3. **Test Changes**: Ensure that all features work correctly after the updates.'), AlpacaItem(instruction='How often should contributors perform code linting and formatting?', input='', output='Contributors should perform code linting and formatting regularly, ideally before every commit. This ensures that the code adheres to project standards and maintains quality throughout the development process.'), AlpacaItem(instruction='What are the benefits of participating in the CAMEL community?', input='', output='Participating in the CAMEL community offers several benefits:\\n1. **Learning Opportunities**: Gain insights from experienced developers and contributors.\\n2. **Networking**: Build connections with like-minded individuals in the open-source space.\\n3. **Skill Development**: Enhance coding, documentation, and collaboration skills through active contribution.'), AlpacaItem(instruction='What should be included in a pull request description?', input='', output='A pull request description should include:\\n1. **Summary of Changes**: A brief overview of the modifications made.\\n2. **Related Issues**: Any issues that the pull request addresses or relates to.\\n3. **Testing Details**: Information on how the changes were tested and any relevant test cases.'), AlpacaItem(instruction='How can contributors ensure their code is reproducible?', input='', output='Contributors can ensure their code is reproducible by:\\n1. **Providing Clear Instructions**: Include step-by-step guides for running the code.\\n2. **Using Environment Management**: Specify dependencies and use tools like Poetry for environment management.\\n3. **Including Test Cases**: Write unit tests that verify the code works as intended.'), AlpacaItem(instruction='What is the recommended approach for handling large pull requests?', input='', output='The recommended approach for handling large pull requests is to:\\n1. **Break Down Changes**: Split the pull request into smaller, manageable pieces.\\n2. **Focus on One Feature**: Ensure that each pull request addresses a specific feature or fix.\\n3. **Review Incrementally**: Encourage reviewers to assess the pull request in stages to maintain clarity.'), AlpacaItem(instruction='What is the purpose of the `Common Actions` section in CAMEL documentation?', input='', output='The purpose of the `Common Actions` section in CAMEL documentation is to provide contributors with a quick reference for frequently performed tasks, such as updating dependencies, running tests, and building documentation.'), AlpacaItem(instruction='How can contributors give credit for their work in CAMEL?', input='', output='Contributors can give credit for their work in CAMEL by:\\n1. **Notifying Maintainers**: Inform the maintainers if they would like to be recognized on social media.\\n2. **Including Their Names**: Ensure their names are mentioned in the pull request or related documentation.'), AlpacaItem(instruction='What is the importance of having clear and concise explanations in cookbook entries?', input='', output='Clear and concise explanations in cookbook entries are important because:\\n1. **User Understanding**: They help users grasp complex concepts and code quickly.\\n2. **Effective Learning**: Users can learn and apply code examples without confusion.\\n3. **Maintainability**: Well-documented entries make it easier for future contributors to update or modify content.'), AlpacaItem(instruction='What steps should be followed for submitting a documentation update?', input='', output='To submit a documentation update, follow these steps:\\n1. **Identify the Need**: Determine what information needs to be updated or added.\\n2. **Edit Documentation Files**: Make changes in the appropriate documentation files.\\n3. **Create a Pull Request**: Submit a pull request with a detailed description of the updates made.'), AlpacaItem(instruction=\"Explain the role of issue labels in CAMEL's GitHub repository.\", input='', output=\"Issue labels in CAMEL's GitHub repository serve to:\\n1. **Categorize Issues**: Help organize issues by type, such as bugs, features, or documentation.\\n2. **Prioritize Work**: Indicate the importance or urgency of issues for contributors.\\n3. **Facilitate Search**: Enable contributors to quickly find relevant issues based on labels.\"), AlpacaItem(instruction='What is the recommended way to handle feedback on a pull request?', input='', output='The recommended way to handle feedback on a pull request is to:\\n1. **Review Comments Carefully**: Read and understand all feedback provided by reviewers.\\n2. **Make Necessary Changes**: Address the feedback by updating the code as required.\\n3. **Engage in Discussion**: If there are disagreements, discuss the feedback constructively with reviewers.'), AlpacaItem(instruction='What are the benefits of using Google Colab for cookbook writing?', input='', output='The benefits of using Google Colab for cookbook writing include:\\n1. **Interactive Environment**: Allows for running code and explanations side-by-side.\\n2. **Ease of Use**: Colab provides a user-friendly interface for writing and sharing code.\\n3. **Collaborative Features**: Facilitates collaboration with others through sharing and commenting.'), AlpacaItem(instruction='How should contributors approach testing their changes before submitting a pull request?', input='', output='Contributors should approach testing their changes by:\\n1. **Running Unit Tests**: Execute existing unit tests to ensure no functionality is broken.\\n2. **Creating New Tests**: Write new tests for any newly added features or bug fixes.\\n3. **Using Coverage Tools**: Utilize coverage tools to verify that their tests adequately cover the code.'), AlpacaItem(instruction='What is the significance of the `Common Actions` section in CAMEL documentation?', input='', output='The `Common Actions` section in CAMEL documentation is significant because it provides quick and accessible instructions for frequently performed tasks, helping contributors streamline their workflow and maintain consistency in project practices.'), AlpacaItem(instruction='What steps can be taken to improve documentation quality in CAMEL?', input='', output='To improve documentation quality in CAMEL, contributors can:\\n1. **Regularly Review**: Periodically review documentation for accuracy and clarity.\\n2. **Solicit Feedback**: Encourage community members to provide feedback on documentation.\\n3. **Update Frequently**: Ensure that documentation is updated with any changes made to the codebase.'), AlpacaItem(instruction='How can contributors ensure their code changes are secure?', input='', output=\"Contributors can ensure their code changes are secure by:\\n1. **Reviewing Security Practices**: Familiarize themselves with the project's security guidelines.\\n2. **Conducting Security Audits**: Review code for potential vulnerabilities before submission.\\n3. **Writing Tests for Security**: Include tests that check for security issues in their changes.\"), AlpacaItem(instruction='What should contributors keep in mind regarding code performance?', input='', output='Contributors should keep the following in mind regarding code performance:\\n1. **Optimize Algorithms**: Use efficient algorithms and data structures where possible.\\n2. **Avoid Unnecessary Complexity**: Keep code simple and avoid overly complicated solutions.\\n3. **Profile and Benchmark**: Use profiling tools to identify performance bottlenecks and optimize accordingly.'), AlpacaItem(instruction='What is the purpose of the `License` section in the CAMEL documentation?', input='', output='The purpose of the `License` section in the CAMEL documentation is to inform users about the licensing terms under which the CAMEL project is published, specifically indicating that the source code is licensed under Apache 2.0.'), AlpacaItem(instruction='How can contributors utilize the CAMEL community for support?', input='', output='Contributors can utilize the CAMEL community for support by:\\n1. **Joining Communication Channels**: Participate in Discord, WeChat, or Slack for real-time support.\\n2. **Engaging in Discussions**: Ask questions and seek advice from experienced contributors.\\n3. **Sharing Knowledge**: Contribute by sharing their own insights and solutions with others.'), AlpacaItem(instruction='What is the importance of including unit tests with new features?', input='', output='Including unit tests with new features is important because:\\n1. **Ensures Functionality**: Confirms that the new feature works as intended.\\n2. **Prevents Future Breakage**: Helps catch any regressions in future updates to the codebase.\\n3. **Facilitates Maintenance**: Makes it easier for future contributors to understand and maintain the feature.'), AlpacaItem(instruction='What guidelines should be followed when creating issues on GitHub for CAMEL?', input='', output='When creating issues on GitHub for CAMEL, contributors should follow these guidelines:\\n1. **Be Specific**: Clearly describe the issue, including steps to reproduce it.\\n2. **Use Labels**: Apply appropriate labels to categorize the issue.\\n3. **Link Related Issues**: Connect the issue to any related issues for better context.'), AlpacaItem(instruction='How can contributors effectively communicate with maintainers?', input='', output=\"Contributors can effectively communicate with maintainers by:\\n1. **Being Clear and Concise**: Present information and questions in a straightforward manner.\\n2. **Respecting Time**: Be patient and understanding of maintainers' schedules.\\n3. **Providing Context**: Include relevant details that help maintainers understand the issue or request.\"), AlpacaItem(instruction='What steps should be taken if a contributor encounters a conflict during a pull request merge?', input='', output='If a contributor encounters a conflict during a pull request merge, they should:\\n1. **Fetch Updates**: Pull the latest changes from the main branch to their local branch.\\n2. **Resolve Conflicts**: Manually resolve any conflicts in the affected files.\\n3. **Commit Changes**: After resolving conflicts, commit the changes and push them to the pull request.')]\n"
     ]
    }
   ],
   "source": [
    "import random\n",
    "firecrawl = Firecrawl()\n",
    "# Scrape and clean content from a specified URL\n",
    "response = firecrawl.scrape(\n",
    "    url=\"https://github.com/camel-ai/camel/blob/master/CONTRIBUTING.md\"\n",
    ")\n",
    "\n",
    "# Generate the items 50 a time up to 300\n",
    "alpaca_entries = []\n",
    "for start in range(1, 301, 50):\n",
    "    # Combine default examples with random samples from previous generations\n",
    "    current_examples = examples + (random.sample(alpaca_entries,\n",
    "                                                 min(5, len(alpaca_entries)))\n",
    "                                                  if alpaca_entries else [])\n",
    "\n",
    "    batch = generate_alpaca_items(\n",
    "        content=response[\"markdown\"],\n",
    "        n_items=50,\n",
    "        start_num=start,\n",
    "        examples=current_examples\n",
    "    )\n",
    "    print(f\"Generated {len(batch)} items\")\n",
    "    alpaca_entries.extend(batch)\n",
    "\n",
    "print(alpaca_entries)\n",
    "save_json(alpaca_entries, 'alpaca_format_data.json')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "-va4lzdi0eYj"
   },
   "source": [
    "Now to define how each row is formatted"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "6jGOhVcFTMh7"
   },
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "background_save": true,
     "referenced_widgets": [
      "21da9c5e551040f9985b5948cd060a5a",
      "9d38e5e43f8949928b70bd1da1bd7804"
     ]
    },
    "id": "LjY75GoYUCB8",
    "outputId": "8e154493-7ab0-496a-99db-b6e7dab0a687"
   },
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "21da9c5e551040f9985b5948cd060a5a",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Generating train split: 0 examples [00:00, ? examples/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "9d38e5e43f8949928b70bd1da1bd7804",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Map:   0%|          | 0/290 [00:00<?, ? examples/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "EOS_TOKEN = tokenizer.eos_token\n",
    "\n",
    "# Provide function showing how to convert dataset row into inference text\n",
    "def formatting_prompts_func(dataset_row):\n",
    "    return {\n",
    "        \"text\": [\n",
    "            AlpacaItem(instruction=inst, input=inp, output=out)\n",
    "                        .to_string() + EOS_TOKEN # Use handy to_string method\n",
    "            for inst, inp, out in zip(\n",
    "                dataset_row[\"instruction\"],\n",
    "                dataset_row[\"input\"],\n",
    "                dataset_row[\"output\"]\n",
    "            )\n",
    "        ]\n",
    "    }\n",
    "\n",
    "\n",
    "from datasets import load_dataset\n",
    "dataset = load_dataset(\"json\", data_files=\"alpaca_format_data.json\", split=\"train\")\n",
    "dataset = dataset.map(formatting_prompts_func, batched = True,)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "idAEIeSQ3xdS"
   },
   "source": [
    "Train the model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "background_save": true,
     "referenced_widgets": [
      "c5ec4d54a64d4b1d9793bf53767f0ffd"
     ]
    },
    "id": "95_Nn-89DhsL",
    "outputId": "85145546-a842-4542-b218-0964134e358e"
   },
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "c5ec4d54a64d4b1d9793bf53767f0ffd",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Generating train split: 0 examples [00:00, ? examples/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from trl import SFTTrainer\n",
    "from transformers import TrainingArguments\n",
    "from unsloth import is_bfloat16_supported\n",
    "trainer = SFTTrainer(\n",
    "    model = model,\n",
    "    tokenizer = tokenizer,\n",
    "    train_dataset = dataset,\n",
    "    dataset_text_field = \"text\",\n",
    "    max_seq_length = 512,\n",
    "    dataset_num_proc = 2,\n",
    "    packing = True, # Packs short sequences together to save time!\n",
    "    args = TrainingArguments(\n",
    "        per_device_train_batch_size = 2,\n",
    "        gradient_accumulation_steps = 4,\n",
    "        warmup_ratio = 0.1,\n",
    "        num_train_epochs = 40,\n",
    "        learning_rate = 2e-3,\n",
    "        fp16 = not is_bfloat16_supported(),\n",
    "        bf16 = is_bfloat16_supported(),\n",
    "        logging_steps = 1,\n",
    "        optim = \"adamw_8bit\",\n",
    "        weight_decay = 0.1,\n",
    "        lr_scheduler_type = \"linear\",\n",
    "        seed = 3407,\n",
    "        output_dir = \"outputs\",\n",
    "        report_to = \"none\", # Use this for WandB etc\n",
    "    ),\n",
    ")\n",
    "# Ensure model is fully back in training mode\n",
    "model = FastLanguageModel.for_training(model)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 1000,
     "referenced_widgets": [
      "9a1ae8238c3b48e2b4d753aafe00c33c"
     ]
    },
    "id": "yqxqAZ7KJ4oL",
    "outputId": "0613df04-44aa-46b6-bedd-f3b60a911d07"
   },
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "9a1ae8238c3b48e2b4d753aafe00c33c",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Counting untrained tokens:   0%|          | 0/56 [00:00<?, ? examples/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Unsloth: Setting embed_tokens & lm_head untrained tokens to mean(trained) to counteract NaNs during training.\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "==((====))==  Unsloth - 2x faster free finetuning | Num GPUs = 1\n",
      "   \\\\   /|    Num examples = 56 | Num Epochs = 40\n",
      "O^O/ \\_/ \\    Batch size per device = 2 | Gradient Accumulation steps = 4\n",
      "\\        /    Total batch size = 8 | Total steps = 280\n",
      " \"-____-\"     Number of trainable parameters = 156,303,360\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "\n",
       "    <div>\n",
       "      \n",
       "      <progress value='250' max='280' style='width:300px; height:20px; vertical-align: middle;'></progress>\n",
       "      [250/280 09:48 < 01:11, 0.42 it/s, Epoch 35.57/40]\n",
       "    </div>\n",
       "    <table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       " <tr style=\"text-align: left;\">\n",
       "      <th>Step</th>\n",
       "      <th>Training Loss</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>1</td>\n",
       "      <td>15.460000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2</td>\n",
       "      <td>15.468400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3</td>\n",
       "      <td>15.018300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4</td>\n",
       "      <td>14.925600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5</td>\n",
       "      <td>15.390800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6</td>\n",
       "      <td>13.078800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>7</td>\n",
       "      <td>10.951600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>8</td>\n",
       "      <td>8.418600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>9</td>\n",
       "      <td>6.773500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>10</td>\n",
       "      <td>5.550200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>11</td>\n",
       "      <td>4.810200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>12</td>\n",
       "      <td>4.147800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>13</td>\n",
       "      <td>4.007100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>14</td>\n",
       "      <td>3.928000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>15</td>\n",
       "      <td>2.667200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>16</td>\n",
       "      <td>2.650600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>17</td>\n",
       "      <td>2.499000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>18</td>\n",
       "      <td>2.663400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>19</td>\n",
       "      <td>2.547900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>20</td>\n",
       "      <td>2.235200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>21</td>\n",
       "      <td>2.532900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>22</td>\n",
       "      <td>1.376300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>23</td>\n",
       "      <td>1.290800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>24</td>\n",
       "      <td>1.362200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>25</td>\n",
       "      <td>1.455200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>26</td>\n",
       "      <td>1.527000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>27</td>\n",
       "      <td>1.653200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>28</td>\n",
       "      <td>1.605200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>29</td>\n",
       "      <td>0.948600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>30</td>\n",
       "      <td>1.200500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>31</td>\n",
       "      <td>1.140400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>32</td>\n",
       "      <td>1.221700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>33</td>\n",
       "      <td>1.306400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>34</td>\n",
       "      <td>1.352100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>35</td>\n",
       "      <td>1.342400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>36</td>\n",
       "      <td>0.980700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>37</td>\n",
       "      <td>1.019300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>38</td>\n",
       "      <td>0.905500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>39</td>\n",
       "      <td>1.008400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>40</td>\n",
       "      <td>1.245300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>41</td>\n",
       "      <td>1.109700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>42</td>\n",
       "      <td>1.453200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>43</td>\n",
       "      <td>0.797300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>44</td>\n",
       "      <td>1.013500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>45</td>\n",
       "      <td>0.786900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>46</td>\n",
       "      <td>0.894800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>47</td>\n",
       "      <td>1.177700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>48</td>\n",
       "      <td>1.086000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>49</td>\n",
       "      <td>1.651600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>50</td>\n",
       "      <td>0.895400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>51</td>\n",
       "      <td>1.011800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>52</td>\n",
       "      <td>1.160500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>53</td>\n",
       "      <td>1.573800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>54</td>\n",
       "      <td>1.163000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>55</td>\n",
       "      <td>1.072900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>56</td>\n",
       "      <td>1.035000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>57</td>\n",
       "      <td>0.611800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>58</td>\n",
       "      <td>0.743100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>59</td>\n",
       "      <td>1.096500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>60</td>\n",
       "      <td>1.139200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>61</td>\n",
       "      <td>5.855300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>62</td>\n",
       "      <td>1.619300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>63</td>\n",
       "      <td>2.743400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>64</td>\n",
       "      <td>6.773300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>65</td>\n",
       "      <td>1.551500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>66</td>\n",
       "      <td>1.018600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>67</td>\n",
       "      <td>1.284600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>68</td>\n",
       "      <td>1.117300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>69</td>\n",
       "      <td>1.509800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>70</td>\n",
       "      <td>1.074700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>71</td>\n",
       "      <td>0.755100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>72</td>\n",
       "      <td>0.497300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>73</td>\n",
       "      <td>0.875900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>74</td>\n",
       "      <td>0.597500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>75</td>\n",
       "      <td>0.563600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>76</td>\n",
       "      <td>5.032300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>77</td>\n",
       "      <td>0.779900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>78</td>\n",
       "      <td>0.679300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>79</td>\n",
       "      <td>0.577900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>80</td>\n",
       "      <td>0.581000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>81</td>\n",
       "      <td>0.407500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>82</td>\n",
       "      <td>0.902900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>83</td>\n",
       "      <td>0.644100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>84</td>\n",
       "      <td>1.133200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>85</td>\n",
       "      <td>1.693800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>86</td>\n",
       "      <td>0.898600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>87</td>\n",
       "      <td>0.657700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>88</td>\n",
       "      <td>1.592000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>89</td>\n",
       "      <td>0.733100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>90</td>\n",
       "      <td>4.917600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>91</td>\n",
       "      <td>10.263400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>92</td>\n",
       "      <td>15.912000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>93</td>\n",
       "      <td>1.027500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>94</td>\n",
       "      <td>0.480500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>95</td>\n",
       "      <td>0.616700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>96</td>\n",
       "      <td>0.356600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>97</td>\n",
       "      <td>0.444900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>98</td>\n",
       "      <td>0.373300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>99</td>\n",
       "      <td>0.169900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>100</td>\n",
       "      <td>0.421400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>101</td>\n",
       "      <td>0.390900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>102</td>\n",
       "      <td>0.608500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>103</td>\n",
       "      <td>0.467300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>104</td>\n",
       "      <td>0.441600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>105</td>\n",
       "      <td>0.422500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>106</td>\n",
       "      <td>0.222500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>107</td>\n",
       "      <td>5.019700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>108</td>\n",
       "      <td>0.546100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>109</td>\n",
       "      <td>0.521400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>110</td>\n",
       "      <td>0.753000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>111</td>\n",
       "      <td>0.584300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>112</td>\n",
       "      <td>0.837300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>113</td>\n",
       "      <td>0.472400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>114</td>\n",
       "      <td>0.333900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>115</td>\n",
       "      <td>0.428700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>116</td>\n",
       "      <td>0.467700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>117</td>\n",
       "      <td>0.369400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>118</td>\n",
       "      <td>0.344600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>119</td>\n",
       "      <td>0.395600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>120</td>\n",
       "      <td>0.357300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>121</td>\n",
       "      <td>0.300700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>122</td>\n",
       "      <td>0.325000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>123</td>\n",
       "      <td>1.147700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>124</td>\n",
       "      <td>0.571100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>125</td>\n",
       "      <td>0.716600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>126</td>\n",
       "      <td>0.876000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>127</td>\n",
       "      <td>0.438000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>128</td>\n",
       "      <td>0.252000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>129</td>\n",
       "      <td>0.387100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>130</td>\n",
       "      <td>0.275600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>131</td>\n",
       "      <td>0.732000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>132</td>\n",
       "      <td>0.538800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>133</td>\n",
       "      <td>0.491600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>134</td>\n",
       "      <td>0.258900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>135</td>\n",
       "      <td>0.256400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>136</td>\n",
       "      <td>0.289900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>137</td>\n",
       "      <td>0.243500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>138</td>\n",
       "      <td>0.282100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>139</td>\n",
       "      <td>0.436600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>140</td>\n",
       "      <td>0.329900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>141</td>\n",
       "      <td>0.192600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>142</td>\n",
       "      <td>0.283100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>143</td>\n",
       "      <td>0.248700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>144</td>\n",
       "      <td>0.236600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>145</td>\n",
       "      <td>0.392700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>146</td>\n",
       "      <td>0.541900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>147</td>\n",
       "      <td>0.308900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>148</td>\n",
       "      <td>0.215700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>149</td>\n",
       "      <td>0.292200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>150</td>\n",
       "      <td>0.280200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>151</td>\n",
       "      <td>0.228000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>152</td>\n",
       "      <td>0.215800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>153</td>\n",
       "      <td>0.183700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>154</td>\n",
       "      <td>0.360800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>155</td>\n",
       "      <td>0.106800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>156</td>\n",
       "      <td>0.110200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>157</td>\n",
       "      <td>0.172400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>158</td>\n",
       "      <td>0.151800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>159</td>\n",
       "      <td>0.337000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>160</td>\n",
       "      <td>0.206900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>161</td>\n",
       "      <td>0.350600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>162</td>\n",
       "      <td>0.095200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>163</td>\n",
       "      <td>0.127200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>164</td>\n",
       "      <td>0.146800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>165</td>\n",
       "      <td>0.191800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>166</td>\n",
       "      <td>0.278800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>167</td>\n",
       "      <td>0.203200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>168</td>\n",
       "      <td>0.193900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>169</td>\n",
       "      <td>0.062100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>170</td>\n",
       "      <td>0.158200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>171</td>\n",
       "      <td>0.173700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>172</td>\n",
       "      <td>0.276500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>173</td>\n",
       "      <td>0.247900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>174</td>\n",
       "      <td>0.246000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>175</td>\n",
       "      <td>0.177600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>176</td>\n",
       "      <td>0.166400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>177</td>\n",
       "      <td>0.153300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>178</td>\n",
       "      <td>0.104300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>179</td>\n",
       "      <td>0.082900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>180</td>\n",
       "      <td>0.120300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>181</td>\n",
       "      <td>0.193300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>182</td>\n",
       "      <td>0.158800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>183</td>\n",
       "      <td>0.101400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>184</td>\n",
       "      <td>0.051500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>185</td>\n",
       "      <td>0.065700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>186</td>\n",
       "      <td>0.492000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>187</td>\n",
       "      <td>0.102400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>188</td>\n",
       "      <td>0.196900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>189</td>\n",
       "      <td>0.202600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>190</td>\n",
       "      <td>0.115700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>191</td>\n",
       "      <td>0.079100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>192</td>\n",
       "      <td>0.115200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>193</td>\n",
       "      <td>0.182000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>194</td>\n",
       "      <td>0.114600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>195</td>\n",
       "      <td>0.132200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>196</td>\n",
       "      <td>0.135900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>197</td>\n",
       "      <td>0.063800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>198</td>\n",
       "      <td>0.049400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>199</td>\n",
       "      <td>0.056400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>200</td>\n",
       "      <td>0.060900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>201</td>\n",
       "      <td>0.111500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>202</td>\n",
       "      <td>0.079900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>203</td>\n",
       "      <td>0.120600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>204</td>\n",
       "      <td>0.034400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>205</td>\n",
       "      <td>0.044000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>206</td>\n",
       "      <td>0.088100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>207</td>\n",
       "      <td>0.041800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>208</td>\n",
       "      <td>0.055100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>209</td>\n",
       "      <td>0.067700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>210</td>\n",
       "      <td>0.084300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>211</td>\n",
       "      <td>0.018500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>212</td>\n",
       "      <td>0.031700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>213</td>\n",
       "      <td>0.023000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>214</td>\n",
       "      <td>0.049500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>215</td>\n",
       "      <td>0.050600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>216</td>\n",
       "      <td>0.071000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>217</td>\n",
       "      <td>0.064800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>218</td>\n",
       "      <td>0.034000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>219</td>\n",
       "      <td>0.025900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>220</td>\n",
       "      <td>0.028800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>221</td>\n",
       "      <td>0.017200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>222</td>\n",
       "      <td>0.040000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>223</td>\n",
       "      <td>0.047600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>224</td>\n",
       "      <td>0.057600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>225</td>\n",
       "      <td>0.013700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>226</td>\n",
       "      <td>0.008300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>227</td>\n",
       "      <td>0.027100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>228</td>\n",
       "      <td>0.016100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>229</td>\n",
       "      <td>0.017700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>230</td>\n",
       "      <td>0.068300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>231</td>\n",
       "      <td>0.017000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>232</td>\n",
       "      <td>0.010700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>233</td>\n",
       "      <td>0.010600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>234</td>\n",
       "      <td>0.009200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>235</td>\n",
       "      <td>0.011800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>236</td>\n",
       "      <td>0.005800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>237</td>\n",
       "      <td>0.022100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>238</td>\n",
       "      <td>0.025600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>239</td>\n",
       "      <td>0.018900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>240</td>\n",
       "      <td>0.010100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>241</td>\n",
       "      <td>0.003800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>242</td>\n",
       "      <td>0.005600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>243</td>\n",
       "      <td>0.007100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>244</td>\n",
       "      <td>0.012300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>245</td>\n",
       "      <td>0.008400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>246</td>\n",
       "      <td>0.005600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>247</td>\n",
       "      <td>0.006700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>248</td>\n",
       "      <td>0.007800</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table><p>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "\n",
       "    <div>\n",
       "      \n",
       "      <progress value='280' max='280' style='width:300px; height:20px; vertical-align: middle;'></progress>\n",
       "      [280/280 11:09, Epoch 40/40]\n",
       "    </div>\n",
       "    <table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       " <tr style=\"text-align: left;\">\n",
       "      <th>Step</th>\n",
       "      <th>Training Loss</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>1</td>\n",
       "      <td>15.460000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2</td>\n",
       "      <td>15.468400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3</td>\n",
       "      <td>15.018300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4</td>\n",
       "      <td>14.925600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5</td>\n",
       "      <td>15.390800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6</td>\n",
       "      <td>13.078800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>7</td>\n",
       "      <td>10.951600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>8</td>\n",
       "      <td>8.418600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>9</td>\n",
       "      <td>6.773500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>10</td>\n",
       "      <td>5.550200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>11</td>\n",
       "      <td>4.810200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>12</td>\n",
       "      <td>4.147800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>13</td>\n",
       "      <td>4.007100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>14</td>\n",
       "      <td>3.928000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>15</td>\n",
       "      <td>2.667200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>16</td>\n",
       "      <td>2.650600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>17</td>\n",
       "      <td>2.499000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>18</td>\n",
       "      <td>2.663400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>19</td>\n",
       "      <td>2.547900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>20</td>\n",
       "      <td>2.235200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>21</td>\n",
       "      <td>2.532900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>22</td>\n",
       "      <td>1.376300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>23</td>\n",
       "      <td>1.290800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>24</td>\n",
       "      <td>1.362200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>25</td>\n",
       "      <td>1.455200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>26</td>\n",
       "      <td>1.527000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>27</td>\n",
       "      <td>1.653200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>28</td>\n",
       "      <td>1.605200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>29</td>\n",
       "      <td>0.948600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>30</td>\n",
       "      <td>1.200500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>31</td>\n",
       "      <td>1.140400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>32</td>\n",
       "      <td>1.221700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>33</td>\n",
       "      <td>1.306400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>34</td>\n",
       "      <td>1.352100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>35</td>\n",
       "      <td>1.342400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>36</td>\n",
       "      <td>0.980700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>37</td>\n",
       "      <td>1.019300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>38</td>\n",
       "      <td>0.905500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>39</td>\n",
       "      <td>1.008400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>40</td>\n",
       "      <td>1.245300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>41</td>\n",
       "      <td>1.109700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>42</td>\n",
       "      <td>1.453200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>43</td>\n",
       "      <td>0.797300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>44</td>\n",
       "      <td>1.013500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>45</td>\n",
       "      <td>0.786900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>46</td>\n",
       "      <td>0.894800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>47</td>\n",
       "      <td>1.177700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>48</td>\n",
       "      <td>1.086000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>49</td>\n",
       "      <td>1.651600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>50</td>\n",
       "      <td>0.895400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>51</td>\n",
       "      <td>1.011800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>52</td>\n",
       "      <td>1.160500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>53</td>\n",
       "      <td>1.573800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>54</td>\n",
       "      <td>1.163000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>55</td>\n",
       "      <td>1.072900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>56</td>\n",
       "      <td>1.035000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>57</td>\n",
       "      <td>0.611800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>58</td>\n",
       "      <td>0.743100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>59</td>\n",
       "      <td>1.096500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>60</td>\n",
       "      <td>1.139200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>61</td>\n",
       "      <td>5.855300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>62</td>\n",
       "      <td>1.619300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>63</td>\n",
       "      <td>2.743400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>64</td>\n",
       "      <td>6.773300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>65</td>\n",
       "      <td>1.551500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>66</td>\n",
       "      <td>1.018600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>67</td>\n",
       "      <td>1.284600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>68</td>\n",
       "      <td>1.117300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>69</td>\n",
       "      <td>1.509800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>70</td>\n",
       "      <td>1.074700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>71</td>\n",
       "      <td>0.755100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>72</td>\n",
       "      <td>0.497300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>73</td>\n",
       "      <td>0.875900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>74</td>\n",
       "      <td>0.597500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>75</td>\n",
       "      <td>0.563600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>76</td>\n",
       "      <td>5.032300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>77</td>\n",
       "      <td>0.779900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>78</td>\n",
       "      <td>0.679300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>79</td>\n",
       "      <td>0.577900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>80</td>\n",
       "      <td>0.581000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>81</td>\n",
       "      <td>0.407500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>82</td>\n",
       "      <td>0.902900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>83</td>\n",
       "      <td>0.644100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>84</td>\n",
       "      <td>1.133200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>85</td>\n",
       "      <td>1.693800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>86</td>\n",
       "      <td>0.898600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>87</td>\n",
       "      <td>0.657700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>88</td>\n",
       "      <td>1.592000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>89</td>\n",
       "      <td>0.733100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>90</td>\n",
       "      <td>4.917600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>91</td>\n",
       "      <td>10.263400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>92</td>\n",
       "      <td>15.912000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>93</td>\n",
       "      <td>1.027500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>94</td>\n",
       "      <td>0.480500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>95</td>\n",
       "      <td>0.616700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>96</td>\n",
       "      <td>0.356600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>97</td>\n",
       "      <td>0.444900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>98</td>\n",
       "      <td>0.373300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>99</td>\n",
       "      <td>0.169900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>100</td>\n",
       "      <td>0.421400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>101</td>\n",
       "      <td>0.390900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>102</td>\n",
       "      <td>0.608500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>103</td>\n",
       "      <td>0.467300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>104</td>\n",
       "      <td>0.441600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>105</td>\n",
       "      <td>0.422500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>106</td>\n",
       "      <td>0.222500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>107</td>\n",
       "      <td>5.019700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>108</td>\n",
       "      <td>0.546100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>109</td>\n",
       "      <td>0.521400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>110</td>\n",
       "      <td>0.753000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>111</td>\n",
       "      <td>0.584300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>112</td>\n",
       "      <td>0.837300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>113</td>\n",
       "      <td>0.472400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>114</td>\n",
       "      <td>0.333900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>115</td>\n",
       "      <td>0.428700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>116</td>\n",
       "      <td>0.467700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>117</td>\n",
       "      <td>0.369400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>118</td>\n",
       "      <td>0.344600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>119</td>\n",
       "      <td>0.395600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>120</td>\n",
       "      <td>0.357300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>121</td>\n",
       "      <td>0.300700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>122</td>\n",
       "      <td>0.325000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>123</td>\n",
       "      <td>1.147700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>124</td>\n",
       "      <td>0.571100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>125</td>\n",
       "      <td>0.716600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>126</td>\n",
       "      <td>0.876000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>127</td>\n",
       "      <td>0.438000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>128</td>\n",
       "      <td>0.252000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>129</td>\n",
       "      <td>0.387100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>130</td>\n",
       "      <td>0.275600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>131</td>\n",
       "      <td>0.732000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>132</td>\n",
       "      <td>0.538800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>133</td>\n",
       "      <td>0.491600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>134</td>\n",
       "      <td>0.258900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>135</td>\n",
       "      <td>0.256400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>136</td>\n",
       "      <td>0.289900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>137</td>\n",
       "      <td>0.243500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>138</td>\n",
       "      <td>0.282100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>139</td>\n",
       "      <td>0.436600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>140</td>\n",
       "      <td>0.329900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>141</td>\n",
       "      <td>0.192600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>142</td>\n",
       "      <td>0.283100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>143</td>\n",
       "      <td>0.248700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>144</td>\n",
       "      <td>0.236600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>145</td>\n",
       "      <td>0.392700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>146</td>\n",
       "      <td>0.541900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>147</td>\n",
       "      <td>0.308900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>148</td>\n",
       "      <td>0.215700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>149</td>\n",
       "      <td>0.292200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>150</td>\n",
       "      <td>0.280200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>151</td>\n",
       "      <td>0.228000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>152</td>\n",
       "      <td>0.215800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>153</td>\n",
       "      <td>0.183700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>154</td>\n",
       "      <td>0.360800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>155</td>\n",
       "      <td>0.106800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>156</td>\n",
       "      <td>0.110200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>157</td>\n",
       "      <td>0.172400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>158</td>\n",
       "      <td>0.151800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>159</td>\n",
       "      <td>0.337000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>160</td>\n",
       "      <td>0.206900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>161</td>\n",
       "      <td>0.350600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>162</td>\n",
       "      <td>0.095200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>163</td>\n",
       "      <td>0.127200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>164</td>\n",
       "      <td>0.146800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>165</td>\n",
       "      <td>0.191800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>166</td>\n",
       "      <td>0.278800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>167</td>\n",
       "      <td>0.203200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>168</td>\n",
       "      <td>0.193900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>169</td>\n",
       "      <td>0.062100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>170</td>\n",
       "      <td>0.158200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>171</td>\n",
       "      <td>0.173700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>172</td>\n",
       "      <td>0.276500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>173</td>\n",
       "      <td>0.247900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>174</td>\n",
       "      <td>0.246000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>175</td>\n",
       "      <td>0.177600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>176</td>\n",
       "      <td>0.166400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>177</td>\n",
       "      <td>0.153300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>178</td>\n",
       "      <td>0.104300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>179</td>\n",
       "      <td>0.082900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>180</td>\n",
       "      <td>0.120300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>181</td>\n",
       "      <td>0.193300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>182</td>\n",
       "      <td>0.158800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>183</td>\n",
       "      <td>0.101400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>184</td>\n",
       "      <td>0.051500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>185</td>\n",
       "      <td>0.065700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>186</td>\n",
       "      <td>0.492000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>187</td>\n",
       "      <td>0.102400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>188</td>\n",
       "      <td>0.196900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>189</td>\n",
       "      <td>0.202600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>190</td>\n",
       "      <td>0.115700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>191</td>\n",
       "      <td>0.079100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>192</td>\n",
       "      <td>0.115200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>193</td>\n",
       "      <td>0.182000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>194</td>\n",
       "      <td>0.114600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>195</td>\n",
       "      <td>0.132200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>196</td>\n",
       "      <td>0.135900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>197</td>\n",
       "      <td>0.063800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>198</td>\n",
       "      <td>0.049400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>199</td>\n",
       "      <td>0.056400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>200</td>\n",
       "      <td>0.060900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>201</td>\n",
       "      <td>0.111500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>202</td>\n",
       "      <td>0.079900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>203</td>\n",
       "      <td>0.120600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>204</td>\n",
       "      <td>0.034400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>205</td>\n",
       "      <td>0.044000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>206</td>\n",
       "      <td>0.088100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>207</td>\n",
       "      <td>0.041800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>208</td>\n",
       "      <td>0.055100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>209</td>\n",
       "      <td>0.067700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>210</td>\n",
       "      <td>0.084300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>211</td>\n",
       "      <td>0.018500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>212</td>\n",
       "      <td>0.031700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>213</td>\n",
       "      <td>0.023000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>214</td>\n",
       "      <td>0.049500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>215</td>\n",
       "      <td>0.050600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>216</td>\n",
       "      <td>0.071000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>217</td>\n",
       "      <td>0.064800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>218</td>\n",
       "      <td>0.034000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>219</td>\n",
       "      <td>0.025900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>220</td>\n",
       "      <td>0.028800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>221</td>\n",
       "      <td>0.017200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>222</td>\n",
       "      <td>0.040000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>223</td>\n",
       "      <td>0.047600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>224</td>\n",
       "      <td>0.057600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>225</td>\n",
       "      <td>0.013700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>226</td>\n",
       "      <td>0.008300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>227</td>\n",
       "      <td>0.027100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>228</td>\n",
       "      <td>0.016100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>229</td>\n",
       "      <td>0.017700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>230</td>\n",
       "      <td>0.068300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>231</td>\n",
       "      <td>0.017000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>232</td>\n",
       "      <td>0.010700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>233</td>\n",
       "      <td>0.010600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>234</td>\n",
       "      <td>0.009200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>235</td>\n",
       "      <td>0.011800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>236</td>\n",
       "      <td>0.005800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>237</td>\n",
       "      <td>0.022100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>238</td>\n",
       "      <td>0.025600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>239</td>\n",
       "      <td>0.018900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>240</td>\n",
       "      <td>0.010100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>241</td>\n",
       "      <td>0.003800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>242</td>\n",
       "      <td>0.005600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>243</td>\n",
       "      <td>0.007100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>244</td>\n",
       "      <td>0.012300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>245</td>\n",
       "      <td>0.008400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>246</td>\n",
       "      <td>0.005600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>247</td>\n",
       "      <td>0.006700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>248</td>\n",
       "      <td>0.007800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>249</td>\n",
       "      <td>0.007800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>250</td>\n",
       "      <td>0.004900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>251</td>\n",
       "      <td>0.005500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>252</td>\n",
       "      <td>0.008000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>253</td>\n",
       "      <td>0.006200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>254</td>\n",
       "      <td>0.003100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>255</td>\n",
       "      <td>0.007700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>256</td>\n",
       "      <td>0.009300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>257</td>\n",
       "      <td>0.006900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>258</td>\n",
       "      <td>0.005300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>259</td>\n",
       "      <td>0.003200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>260</td>\n",
       "      <td>0.004200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>261</td>\n",
       "      <td>0.005800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>262</td>\n",
       "      <td>0.006500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>263</td>\n",
       "      <td>0.002100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>264</td>\n",
       "      <td>0.005400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>265</td>\n",
       "      <td>0.008900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>266</td>\n",
       "      <td>0.003100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>267</td>\n",
       "      <td>0.009100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>268</td>\n",
       "      <td>0.006200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>269</td>\n",
       "      <td>0.007700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>270</td>\n",
       "      <td>0.001200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>271</td>\n",
       "      <td>0.003000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>272</td>\n",
       "      <td>0.003200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>273</td>\n",
       "      <td>0.004000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>274</td>\n",
       "      <td>0.007700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>275</td>\n",
       "      <td>0.001800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>276</td>\n",
       "      <td>0.002400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>277</td>\n",
       "      <td>0.006400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>278</td>\n",
       "      <td>0.005500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>279</td>\n",
       "      <td>0.002700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>280</td>\n",
       "      <td>0.006600</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table><p>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "dtrainer_stats = trainer.train()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "ekOmTR1hSNcr"
   },
   "source": [
    "<a name=\"Inference\"></a>\n",
    "### Inference\n",
    "Let's run the model! You can change the instruction and input - leave the output blank!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "kR3gIAX-SM2q",
    "outputId": "e2186447-a801-4f5f-cf41-a7b91a8d9779"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['<s> ### Instruction:\\nExplain how can I stay up to date with the CAMEL community.\\n\\n### Input:\\n\\n\\n### Response:\\nTo keep up to date with the CAMEL community, engage in discussions, contribute to the Discord, and provide support to new contributors.</s>']"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "FastLanguageModel.for_inference(model) # Enable native 2x faster inference\n",
    "inputs = tokenizer(\n",
    "[\n",
    "\n",
    "    AlpacaItem(\n",
    "        instruction=\"Explain how can I stay up to date with the CAMEL community.\",\n",
    "        input=\"\",\n",
    "        output=\"\", # leave this blank for generation!\n",
    "    ).to_string()\n",
    "\n",
    "], return_tensors = \"pt\").to(\"cuda\")\n",
    "\n",
    "outputs = model.generate(**inputs, max_new_tokens = 512, use_cache = True)\n",
    "tokenizer.batch_decode(outputs)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "xSepmhPrgOct"
   },
   "source": [
    "**Summary**\n",
    "\n",
    "\n",
    "We have generated realistic user queries and responses from a real page and trained on them to produce a model that understands the underlying content."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "_75hf2ZmQ1-M"
   },
   "source": [
    "That's everything: Got questions about 🐫 CAMEL-AI? Join us on [Discord](https://discord.camel-ai.org)! Whether you want to share feedback, explore the latest in multi-agent systems, get support, or connect with others on exciting projects, we’d love to have you in the community! 🤝\n",
    "\n",
    "Check out some of our other work:\n",
    "\n",
    "1. 🐫 Creating Your First CAMEL Agent [free Colab](https://docs.camel-ai.org/cookbooks/create_your_first_agent.html)\n",
    "\n",
    "2.  Graph RAG Cookbook [free Colab](https://colab.research.google.com/drive/1uZKQSuu0qW6ukkuSv9TukLB9bVaS1H0U?usp=sharing)\n",
    "\n",
    "3. 🧑‍⚖️ Create A Hackathon Judge Committee with Workforce [free Colab](https://colab.research.google.com/drive/18ajYUMfwDx3WyrjHow3EvUMpKQDcrLtr?usp=sharing)\n",
    "\n",
    "4. 🔥 3 ways to ingest data from websites with Firecrawl & CAMEL [free Colab](https://colab.research.google.com/drive/1lOmM3VmgR1hLwDKdeLGFve_75RFW0R9I?usp=sharing)\n",
    "\n",
    "5. 🦥 Agentic SFT Data Generation with CAMEL and Mistral Models, Fine-Tuned with Unsloth [free Colab](https://colab.research.google.com/drive/1lYgArBw7ARVPSpdwgKLYnp_NEXiNDOd-?usp=sharing)\n",
    "\n",
    "6. 🦥 Agentic SFT Data Generation with CAMEL and Qwen Models, Fine-Tuned with Unsloth [free Colab](https://colab.research.google.com/drive/1sMnWOvdmASEMhsRIOUSAeYuEywby6FRV?usp=sharing)\n",
    "\n",
    "Thanks from everyone at 🐫 CAMEL-AI\n",
    "\n",
    "\n",
    "<div class=\"align-center\">\n",
    "  <a href=\"https://www.camel-ai.org/\"><img src=\"https://i.postimg.cc/KzQ5rfBC/button.png\"width=\"150\"></a>\n",
    "  <a href=\"https://discord.camel-ai.org\"><img src=\"https://i.postimg.cc/L4wPdG9N/join-2.png\"  width=\"150\"></a></a>\n",
    "  \n",
    "⭐ <i>Star us on [*Github*](https://github.com/camel-ai/camel), join our [*Discord*](https://discord.camel-ai.org) or follow our [*X*](https://x.com/camelaiorg)\n",
    "</div>"
   ]
  }
 ],
 "metadata": {
  "accelerator": "GPU",
  "colab": {
   "provenance": []
  },
  "kernelspec": {
   "display_name": "Python 3",
   "name": "python3"
  },
  "language_info": {
   "name": "python"
  },
  "widgets": {
   "application/vnd.jupyter.widget-state+json": {
    "00307ddeb366496abcb81dada5ec01e6": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "04e99d4f4d784289bb5e442fac2f447c": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "07f5cb55a7914ba994acda44294db8ac": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "09717565e7a94331b8e3e9618f5eb3af": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_3f60fe4920424667acf9a0bd9ec403de",
      "max": 124,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_a978e1e9f9344a17899a8839372e0104",
      "value": 124
     }
    },
    "09744e002e3e47448b5c807424bf6956": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_92408a369da54dd7bcddf6f6e50e9647",
       "IPY_MODEL_eecd38a827cd4e7e94759e2497ed471e",
       "IPY_MODEL_a9cf69cbe2314ec2a2e928e30db6dbfa"
      ],
      "layout": "IPY_MODEL_eba29435f8f2428d87cf757c343bf6e7"
     }
    },
    "0d53408d8ede4b699ad2cf635938451b": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_721b011e999e4f118facc65914af1c87",
       "IPY_MODEL_09717565e7a94331b8e3e9618f5eb3af",
       "IPY_MODEL_bd8a573b5b7a46a2b9e3f5fad61730e2"
      ],
      "layout": "IPY_MODEL_04e99d4f4d784289bb5e442fac2f447c"
     }
    },
    "12a89422ee874ad39ca8144c310b4014": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "12c81caf98ed4c4cac311a021162a564": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_3867254073fb4e52b1a56fb07752aa1c",
       "IPY_MODEL_17bf788adc944f4cab1c8bdb0bb64b8d",
       "IPY_MODEL_6026736dd09744f3b52ae6390cd89194"
      ],
      "layout": "IPY_MODEL_c4252aeb37914583a57284bf0c6af3fe"
     }
    },
    "1591d9b09c8443579e37db07dbad1224": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_c08e4858f6eb4c0ebd5c5af58e0b7328",
      "placeholder": "​",
      "style": "IPY_MODEL_c85d4cd76dbe42a4bd0613fd01ebf787",
      "value": "tokenizer.json: 100%"
     }
    },
    "17bf788adc944f4cab1c8bdb0bb64b8d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_6e57e5cdca8643ee9e23a46b9ccdffb0",
      "max": 948,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_8a695679ac3446518d3e61b30bc532f4",
      "value": 948
     }
    },
    "17d37e474ba34bedaa89830f543e5809": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "195b7fa1e3c546f5a93c10ec03b728a9": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_1591d9b09c8443579e37db07dbad1224",
       "IPY_MODEL_c238699464f84887a715fadf4ce1f220",
       "IPY_MODEL_b0f411fbcc474290b0f087b5ea9e8f08"
      ],
      "layout": "IPY_MODEL_95b6473d466944ebbcf5532c2ddb7558"
     }
    },
    "1dd1ed4aaf964078b26b597c5318dc8e": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "30d16cafe76f4c74913c81f826d40208": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_bc3b2868f4994714a887a889e3a2a18e",
      "placeholder": "​",
      "style": "IPY_MODEL_55e8c726ecf548b9b4fe6d5248bfd149",
      "value": " 438/438 [00:00&lt;00:00, 20.1kB/s]"
     }
    },
    "381c46960ece4da7aca34180ed6593ff": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_bbd573562ae14387818f82ddb2ff3c40",
      "placeholder": "​",
      "style": "IPY_MODEL_b71a8f4df6824510b70262b9d0538f89",
      "value": " 500k/500k [00:00&lt;00:00, 19.7MB/s]"
     }
    },
    "3867254073fb4e52b1a56fb07752aa1c": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_44768e2247cc472f85fb4191c7bebb4a",
      "placeholder": "​",
      "style": "IPY_MODEL_63e04fcb4c784acc9a8e906840ce5777",
      "value": "tokenizer_config.json: 100%"
     }
    },
    "39d3a5a6441447fb88c2713a6baa918d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "3b1c9d5fa7e84af28dc1603a9d62d794": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "3f60fe4920424667acf9a0bd9ec403de": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "41da75ce3a1042469aebb4615aaad93b": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "44768e2247cc472f85fb4191c7bebb4a": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "50e2bab66cf844689c5fddbe818fec69": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "55e8c726ecf548b9b4fe6d5248bfd149": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "57a028baaf034aa7b5ec44e4566f1802": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "5c24251b8c85417eb738e8cc73ec4cec": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "6026736dd09744f3b52ae6390cd89194": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_eedbe8cf22f343289451142ddfd25b2e",
      "placeholder": "​",
      "style": "IPY_MODEL_9e3b451a55984289a9ba58106387e823",
      "value": " 948/948 [00:00&lt;00:00, 70.4kB/s]"
     }
    },
    "63e04fcb4c784acc9a8e906840ce5777": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "6c7c652bb3204ee5bbc43662668b41f1": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "6e57e5cdca8643ee9e23a46b9ccdffb0": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "6e9e0866439c444eb0830ddb2c0a8f0b": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "71bd3e831d2f446cac805d6253136f4d": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "721b011e999e4f118facc65914af1c87": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_a92a81934edb4fc19c4603cdf9489559",
      "placeholder": "​",
      "style": "IPY_MODEL_39d3a5a6441447fb88c2713a6baa918d",
      "value": "generation_config.json: 100%"
     }
    },
    "79f048b5c736497caae92fdc894a9224": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_8474b7c07b744960928212e6ec6605bc",
      "placeholder": "​",
      "style": "IPY_MODEL_5c24251b8c85417eb738e8cc73ec4cec",
      "value": "tokenizer.model: 100%"
     }
    },
    "7dd901a8afe34e5c82523b3079deedbb": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "8058a98caaa5479c827c762dcaecdc7a": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "8474b7c07b744960928212e6ec6605bc": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "85803d76d70c4cabaa1f1ddc88c36ef3": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "8a695679ac3446518d3e61b30bc532f4": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "92408a369da54dd7bcddf6f6e50e9647": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_db51939f8da94b58a21cd945efc1bd63",
      "placeholder": "​",
      "style": "IPY_MODEL_8058a98caaa5479c827c762dcaecdc7a",
      "value": "model.safetensors: 100%"
     }
    },
    "92cb2cbe77294e45b27041112bc1d7c6": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_79f048b5c736497caae92fdc894a9224",
       "IPY_MODEL_ed2e51a68ba346b38f59e95a264b72ac",
       "IPY_MODEL_381c46960ece4da7aca34180ed6593ff"
      ],
      "layout": "IPY_MODEL_9afdd6b7bc354237843b524026223185"
     }
    },
    "95b6473d466944ebbcf5532c2ddb7558": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "95ed6c2c3131498e93f341159647cd75": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "97744bb661a8491d881b66201717650d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_1dd1ed4aaf964078b26b597c5318dc8e",
      "placeholder": "​",
      "style": "IPY_MODEL_41da75ce3a1042469aebb4615aaad93b",
      "value": "special_tokens_map.json: 100%"
     }
    },
    "9a80c47aadd140c3ba4c56eeb533ac77": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "9afdd6b7bc354237843b524026223185": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "9e3b451a55984289a9ba58106387e823": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "a4b5c9dc622f4c4b95418ab1983fb63d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_97744bb661a8491d881b66201717650d",
       "IPY_MODEL_a7dd14f4c0874c27afda0bf9af750d2e",
       "IPY_MODEL_30d16cafe76f4c74913c81f826d40208"
      ],
      "layout": "IPY_MODEL_00307ddeb366496abcb81dada5ec01e6"
     }
    },
    "a7dd14f4c0874c27afda0bf9af750d2e": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_9a80c47aadd140c3ba4c56eeb533ac77",
      "max": 438,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_85803d76d70c4cabaa1f1ddc88c36ef3",
      "value": 438
     }
    },
    "a92a81934edb4fc19c4603cdf9489559": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "a978e1e9f9344a17899a8839372e0104": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "a9cf69cbe2314ec2a2e928e30db6dbfa": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_17d37e474ba34bedaa89830f543e5809",
      "placeholder": "​",
      "style": "IPY_MODEL_57a028baaf034aa7b5ec44e4566f1802",
      "value": " 762M/762M [00:04&lt;00:00, 386MB/s]"
     }
    },
    "ae99567a191740bcb1676c4bc71b8d57": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "b0f411fbcc474290b0f087b5ea9e8f08": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_6c7c652bb3204ee5bbc43662668b41f1",
      "placeholder": "​",
      "style": "IPY_MODEL_50e2bab66cf844689c5fddbe818fec69",
      "value": " 1.84M/1.84M [00:00&lt;00:00, 2.14MB/s]"
     }
    },
    "b71a8f4df6824510b70262b9d0538f89": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "bbd573562ae14387818f82ddb2ff3c40": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "bc3b2868f4994714a887a889e3a2a18e": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "bd8a573b5b7a46a2b9e3f5fad61730e2": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_6e9e0866439c444eb0830ddb2c0a8f0b",
      "placeholder": "​",
      "style": "IPY_MODEL_95ed6c2c3131498e93f341159647cd75",
      "value": " 124/124 [00:00&lt;00:00, 9.21kB/s]"
     }
    },
    "c08e4858f6eb4c0ebd5c5af58e0b7328": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "c238699464f84887a715fadf4ce1f220": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_71bd3e831d2f446cac805d6253136f4d",
      "max": 1842795,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_7dd901a8afe34e5c82523b3079deedbb",
      "value": 1842795
     }
    },
    "c4252aeb37914583a57284bf0c6af3fe": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "c85d4cd76dbe42a4bd0613fd01ebf787": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "db51939f8da94b58a21cd945efc1bd63": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "eba29435f8f2428d87cf757c343bf6e7": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "ed2e51a68ba346b38f59e95a264b72ac": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_3b1c9d5fa7e84af28dc1603a9d62d794",
      "max": 499723,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_12a89422ee874ad39ca8144c310b4014",
      "value": 499723
     }
    },
    "eecd38a827cd4e7e94759e2497ed471e": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "danger",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_ae99567a191740bcb1676c4bc71b8d57",
      "max": 762453544,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_07f5cb55a7914ba994acda44294db8ac",
      "value": 762453472
     }
    },
    "eedbe8cf22f343289451142ddfd25b2e": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    }
   }
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}
